elias, Even before Google removed the robots tester tool, it was much better to have a bulk* robots tester.
bulk: test a bunch of URLs across a bunch of user-agents (all combinations) in one go.
It's still here, it's also open-source:
https://lnkd.in/d9yjtud#advertools #robotstxt #SEO #Dash
How to use:
https://www.youtube.com/watch?v=s0Dx0QV9iEs
