pablolarah, to fediBots
@pablolarah@mastodon.social avatar
r343l, to ai
@r343l@freeradical.zone avatar
r343l,
@r343l@freeradical.zone avatar

I found some posts on blocking AI scraping bots this morning so adding more stuff to my robots.txt

Post: https://adactio.com/journal/20515

Linked to this: https://neil-clarke.com/block-the-bots-that-feed-ai-models-by-scraping-your-website/

Which a comment links to this completely bad behaving AI scrapper: https://soggi.org/misc/articles/Diffbot-blocking-bad-bot-rude-content-scraper-from-websites.htm

"diffbot" apparently will if blocked with "diffbot" in its user-agent retry with other user agents until it gets in. Just trash behavior. :/

recntr, to random

On the 11th of May, we invite Sabine Groenewegen and Riar Rizaldi to present their work on gender, colonialism and ecology, from 15:00-17:00 at KITLV in Leiden.

Discussants: Rachael Rakes & Jo-Lene Ong, moderator Ward Berenschot!

Register here: https://recntr.nl/2023/04/talks-by-sabine-groenewegen-riar-rizaldi-gender-colonialism-ecology-with-kitlv-11-may-2023-1500-1700-leiden-register-to-join/

  • All
  • Subscribed
  • Moderated
  • Favorites
  • JUstTest
  • kavyap
  • DreamBathrooms
  • khanakhh
  • magazineikmin
  • InstantRegret
  • tacticalgear
  • thenastyranch
  • Youngstown
  • rosin
  • slotface
  • modclub
  • everett
  • ngwrru68w68
  • anitta
  • Durango
  • osvaldo12
  • normalnudes
  • cubers
  • ethstaker
  • mdbf
  • provamag3
  • GTA5RPClips
  • cisconetworking
  • Leos
  • tester
  • megavids
  • lostlight
  • All magazines