About Neevabot

Updated: May 6, 2021

  • Neevabot is the web crawler for the search engine neeva.com.
  • Requests from Neevabot set the User-Agent to: Mozilla/5.0 (compatible; Neevabot/1.0; +https://neeva.com/neevabot)
    and originate from IPs where reverse DNS shows it in the *.neevabot.com domain. For example: $ host domain name pointer 100-26-127-17.neevabot.com

  • Standard directives in robots.txt that target Neevabot are respected. For example, the following will allow Neevabot to crawl all pages, except those under /private/:User-Agent: Neevabot
    Allow: /
    Disallow: /private/
  • If there is no rule targeting Neevabot, but there is a rule targeting Googlebot, then Neevabot will follow the Googlebot directives. For example, Neevabot will fetch all pages, except those under /private/ with the following robots.txt: User-Agent: *
    Disallow: /
    User-Agent: Googlebot
    Allow: /
    Disallow: /private/
  • If you have any questions, or if you think Neevabot is misbehaving on your site, please do not hesitate to contact us at neevabot@neeva.co.