flipsideza, 2 months ago If you don't want those #AI bots #scraping your website/blog... time to add a bunch of Disallow: / to your robots.txt!! https://darkvisitors.com/ #WebDev #ChatBots
If you don't want those #AI bots #scraping your website/blog... time to add a bunch of Disallow: / to your robots.txt!!
https://darkvisitors.com/
#WebDev #ChatBots
dcz, 2 months ago @flipsideza ...and enjoy being booted out of search engines at the same time :)
@flipsideza ...and enjoy being booted out of search engines at the same time :)
flipsideza, 1 month ago @dcz for my site I am actually okay with that... I don't even show up on searches anyway ^_^ and refuse to jump through all the SEO hoops every engine has these days.
@dcz for my site I am actually okay with that... I don't even show up on searches anyway ^_^ and refuse to jump through all the SEO hoops every engine has these days.
Add comment