Just Ship It

Meta scraped 67,390 AI training crawls on TrustMRR in 3 days

View on X

Meta is scraping like crazy. AI training crawls last 3 days on TrustMRR: - OpenAI: 409 - Anthropic: 721 - Meta: 67,390

Meta scraped 67,390 AI training crawls on TrustMRR in 3 daysMeta scraped 67,390 AI training crawls on TrustMRR in 3 days
  • 191 replies
  • 71 reposts
  • 2.1K likes
  • 669.6K views

  1. @marclou · Jul 5, 2026

    Context:

    Marc Lou@marclou · Jul 1, 2026I built a bot traffic tracker for @DataFast_ 🤖 It shows what crawlers and AI assistants do on your website: ✨ ChatGPT / Claude fetching pages to answer users 🔎 Google / Bing indexing your site 🧠 OpenAI / Anthropic / Meta crawling for training 📄 The exact pages they crawl 🚫 Pages they try to crawl that return 404s The 404s are interesting because if ChatGPT keeps requesting /free-trial and that page does not exist, that is a signal you should build it! Free for early users, probably not forever. If you try it, I’d love feedback. PS. Let me know your bot/human traffic rate (mine is ~300%! 🤯)
    • 4 replies
    • 5 reposts
    • 128 likes
    • 63.6K views

Join 30,852 readers

How to find startup ideas, launch fast, and get profitable.

Free. Unsubscribe anytime.

More tweets

All tweets →