Right now, robots.txt on lemmy.ca is configured this way

User-Agent: *
  Disallow: /login
  Disallow: /login_reset
  Disallow: /settings
  Disallow: /create_community
  Disallow: /create_post
  Disallow: /create_private_message
  Disallow: /inbox
  Disallow: /setup
  Disallow: /admin
  Disallow: /password_change
  Disallow: /search/
  Disallow: /modlog

Would it be a good idea privacy-wise to deny GPTBot from scrapping content from the server?

User-agent: GPTBot
Disallow: /

Thanks!

You are viewing a single thread.
View all comments View context
14 points

You take action where you can ;)

permalink
report
parent
reply

Lemmy.ca Support / Questions

!lemmy_ca_support@lemmy.ca

Create post

Support / Questions specific to lemmy.ca.

For support / questions related to the lemmy software itself, go to !lemmy_support@lemmy.ml

Community stats

  • 26

    Monthly active users

  • 91

    Posts

  • 318

    Comments