my application suddenly had a huge increase in the number of requests being made to it. I believe the only change of merit was adding a sitemap.xml and I believe the increase in requests is due to crawlers/bots but am not sure how to verify except by taking a sample of requests coming in by reading the logs in my Papertrail addon and investigating the ip addresses (alot of them appear to be from googlebot)