@Matt5sean3
> Better opt-in with yesbot than opt-out with nobot
I get the logic, but it ignores that putting a website online (without password protection) is an act of publishing. Like putting out a press release, it's reasonable to think it's public and meant to be discovered, unless it explicitly says otherwise. The practical result of a yesbot is that although most people want their website discovered, it only gets indexed if they know to put a yesbot in.