pixelriot, 13 days ago

@iamdtms @nixCraft @chriscoyier @beep

Here's a maintained and updated robots.txt from the author of that blog:

https://github.com/ai-robots-txt/ai.robots.txt/blob/main/robots.txt