Technical SEO consultant and lecturer
Translating information retrieval research for SEO practitioners
Specialty
Crawling practitioners
9 people in the Atlas works substantively on crawling, across 4 countries. Listed alphabetically by surname — this is a directory, not a ranking.
9 practitioners · 4 countries
Co-founder and CTO · Sitebulb
Building the Sitebulb crawler
sitebulb.com
Retired search executive, formerly Principal Product Manager at Microsoft Bing
Leading Bing crawling and indexing, and championing IndexNow
Co-founder and CEO · Sitebulb
Co-founding Sitebulb and URL Profiler
sitebulb.com
Analyst, Google Search · Google
Public commentary on Googlebot crawling and indexing
garyillyes.com
Principal Product Manager, Web Data Platform · Microsoft AI
Bing Webmaster Tools and IndexNow product communication
Search Advocate · Google
Google Search Central office hours and public Q&A
Founder · Screaming Frog
Creating the Screaming Frog SEO Spider
screamingfrog.co.uk
Technical SEO consultant · SearchBrothers
Technical audits and manual action recovery
Nobody matches those filters.
What crawling people also work on
Specialties most often held alongside crawling by the people listed above.