elias, 6 months ago to SEO

Even before Google removed the robots tester tool, it was much better to have a bulk* robots tester.

bulk: test a bunch of URLs across a bunch of user-agents (all combinations) in one go.

It's still here, it's also open-source:
https://lnkd.in/d9yjtud

#advertools #robotstxt #SEO #Dash

How to use:
https://www.youtube.com/watch?v=s0Dx0QV9iEs

elias, 9 months ago to python

Analyzing SERPs on a large scale with #Python and #advertools

The recording is now available

🔵 Creating a large set of queries in an industry
🔵 Creating query variants
🔵 Running the requests in bulk
🔵 Running the requests across various dimensions (country, language, etc)
🔵 Visualizing the results with a heatmap

#DataScience #SEO #DataVisualization

https://bit.ly/3E321Fi

elias, 10 months ago to datascience

🕸️🕷️🕸️🕷️🕸️🕷️🕸️

Here is a list of custom extraction XPath selectors to take your crawling to the next level.

https://bit.ly/3Di5TBO

This can be expanded to include other extractors and/or ones for popular sites/CMSes
Amazon, WP, Shopify etc.

If you have a favorite list that you would like to contribute or create please let me know.

#DataScience #advertools #SEO #crawling #Python