DataFast bot traffic now gets 100,000 free requests per cycle
When I first built Bot traffic on DataFast, I made it free for everyone. I wanted you to see when AI assistants, search engines, and other crawlers request pages on your website. As more people started using it (~1K websites now!), processing all those requests became surprisingly expensive (mostly rate limiting and database). To keep the feature sustainable and as affordable as possible, starting on September 15, 2026, every account gets a fresh allowance of 100,000 accepted Bot traffic requests per billing cycle. If you need more after that, an additional 1M requests costs $9/month. You can reduce usage by excluding crawlers you don't want to track. For instance, Meta is scraping like crazy on some websites. Use the cog icon on the bot traffic card to choose what crawlers you want to track. 90% of you guys shouldn't be impacted by this update; it's only for a few websites getting loads of crawlers. If you reach the limit, don't worry: your dashboard stays available and your regular web analytics keeps tracking normally. We only stop recording new Bot traffic until your next billing-cycle reset, unless you add more capacity. Thanks for understanding and for using DataFast ❤️




