Questions? We have answers.

How do Alexa’s crawlers identify themselves?

Alexa crawlers identify themselves in the user-agent string as:

  • Our web-wide crawler:
  • Our audit crawler:
    alexa site audit
  • Our Certification scan crawler:

Please make sure that your site’s robots.txt file or server is not blocking any of our crawlers. For more information about updating your site’s robots.txt file to allow our crawlers please see these pages:

Alexa's Web and Site Audit Crawlers

Certification Crawler Information

Articles in this section