flipsideza,
@flipsideza@fosstodon.org avatar

If you don't want those #AI bots #scraping your website/blog... time to add a bunch of Disallow: / to your robots.txt!!

https://darkvisitors.com/

#WebDev #ChatBots

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • ai
  • Durango
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • osvaldo12
  • khanakhh
  • Youngstown
  • mdbf
  • slotface
  • rosin
  • everett
  • ngwrru68w68
  • kavyap
  • InstantRegret
  • JUstTest
  • GTA5RPClips
  • cubers
  • ethstaker
  • normalnudes
  • tacticalgear
  • cisconetworking
  • tester
  • Leos
  • modclub
  • megavids
  • provamag3
  • anitta
  • lostlight
  • All magazines
    •