AI labs can now fetch my *.md files

It works! AI labs started indexing, training, and serving my new *.md files ✨ Right after pushing to prod, I asked ChatGPT to check {{startup_markdown_URL}}, and it couldn't because of "cache missed" or "400 timeout fetching". So I added all 8,831 URLs to the sitemap.xml and added the following headers: "Content-Type": "text/plain; charset=utf-8" "Content-Disposition": "inline" I can't tell if this helped, but 24 hours later, ChatGPT was able to fetch them properly 😊 Maybe AI assistants need the page to be indexed first, before being able to crawl it?

AI labs can now fetch my *.md files
Marc Lou@marclou · Jul 10, 2026I made TrustMRR readable by AI agents. AI Agents often miss data when they have to scroll pages or run scripts. The goal is to make the startup marketplace easier to browse from ChatGPT, Claude, Gemini, and other AI assistants, so people can discover and acquire startups from chat. So I added public startup .md pages, llms.txt, and a limited /api/ai endpoint to give agents structured data. ChatGPT alone makes nearly as many daily requests as actual humans on TrustMRR. So I'm giving all my startups the best surfboard to ride the AI tsunami.
  • 57 replies
  • 9 reposts
  • 561 likes
  • 118.1K views
  1. @marclou · Jul 13, 2026

    I added wildcard path matching to DataFast's bot traffic feature So it's easier to know if a group of URLs is crawled by AI assistants > datafa.st/docs/bot-traff…

    I added wildcard path matching to DataFast's bot traffic feature So it's easier to know if a group of URLs is crawled by…
    • 3 replies
    • 1 reposts
    • 19 likes
    • 11.1K views

Join 30,853 readers

How to find startup ideas, launch fast, and get profitable.

Free. Unsubscribe anytime.

More tweets

All tweets →