Added @duckdb.org and @evidence.dev docs to the docs-to-llmstxt project. It will generate 1 file per project with all their docs for easier LLM feeding!
github.com/davidgasquez...
github.com/davidgasquez...
docs-to-llmstxt/docs at main · davidgasquez/docs-to-llmstxt
🤖 Compile docs into text files for LLMs. Contribute to davidgasquez/docs-to-llmstxt development by creating an account on GitHub.
github.com
November 20, 2024 at 11:37 AM
Added @duckdb.org and @evidence.dev docs to the docs-to-llmstxt project. It will generate 1 file per project with all their docs for easier LLM feeding!
github.com/davidgasquez...
github.com/davidgasquez...
Inspired by @simonwillison.net llm-docs repo, I did a similar one compiling projects docs into single TXT files that can be fed to LLMs.
Right now, it only has atproto docs but already been useful to me to answer random questions about the project.
github.com/davidgasquez...
Right now, it only has atproto docs but already been useful to me to answer random questions about the project.
github.com/davidgasquez...
GitHub - davidgasquez/docs-to-llmstxt: 🤖 Compile docs into text files for LLMs
🤖 Compile docs into text files for LLMs. Contribute to davidgasquez/docs-to-llmstxt development by creating an account on GitHub.
github.com
November 19, 2024 at 9:48 AM
Inspired by @simonwillison.net llm-docs repo, I did a similar one compiling projects docs into single TXT files that can be fed to LLMs.
Right now, it only has atproto docs but already been useful to me to answer random questions about the project.
github.com/davidgasquez...
Right now, it only has atproto docs but already been useful to me to answer random questions about the project.
github.com/davidgasquez...
there's this thing called man pages, it's like llmstxt but from the 70s
June 10, 2025 at 6:28 PM
there's this thing called man pages, it's like llmstxt but from the 70s
Whoa - Google Search Central added an LLMs.txt file to its portal www.seroundtable.com/google-adds-... via @lidia-infante.com with a response from @johnmu.com
#google #seo #llmstxt
#google #seo #llmstxt
December 3, 2025 at 12:21 PM
Whoa - Google Search Central added an LLMs.txt file to its portal www.seroundtable.com/google-adds-... via @lidia-infante.com with a response from @johnmu.com
#google #seo #llmstxt
#google #seo #llmstxt
Google's @johnmu.com says it makes sense to noindex your LLMS.txt file www.seroundtable.com/google-noind...
#llmstxt #llms #google #seo
#llmstxt #llms #google #seo
July 22, 2025 at 11:31 AM
Google's @johnmu.com says it makes sense to noindex your LLMS.txt file www.seroundtable.com/google-noind...
#llmstxt #llms #google #seo
#llmstxt #llms #google #seo
Additionally, there's also an interesting Plugin by @pawamoy.bsky.social that is used by Astral and the likes:
github.com/pawamoy/mkdo...
github.com/pawamoy/mkdo...
GitHub - pawamoy/mkdocs-llmstxt: MkDocs plugin to generate an /llms.txt file (https://llmstxt.org/).
MkDocs plugin to generate an /llms.txt file (https://llmstxt.org/). - pawamoy/mkdocs-llmstxt
github.com
June 26, 2025 at 9:34 AM
Additionally, there's also an interesting Plugin by @pawamoy.bsky.social that is used by Astral and the likes:
github.com/pawamoy/mkdo...
github.com/pawamoy/mkdo...
https://netcontentseo.net/article/john-mueller-spots-an-unexpected-llmstxt-problem-crawlers-may-discover-the-files-through-third-party-indexes-868 #LLMSTxt #AISEO #Crawlers #SEO (2/2)
September 19, 2026 at 5:38 PM
https://netcontentseo.net/article/john-mueller-spots-an-unexpected-llmstxt-problem-crawlers-may-discover-the-files-through-third-party-indexes-868 #LLMSTxt #AISEO #Crawlers #SEO (2/2)
A lot happened for ngmisl/llmstxt in 2024. Check it out https://wrapped.dev/repo/ngmisl/llmstxt
January 2, 2025 at 7:29 AM
A lot happened for ngmisl/llmstxt in 2024. Check it out https://wrapped.dev/repo/ngmisl/llmstxt
Every decade the web invents a new way to say “Trust me.”
This time it’s llms.txt.
Here’s why the engines and platforms are politely ignoring it (for now).
duaneforresterdecodes.substack.com/p/llmstxt-th...
This time it’s llms.txt.
Here’s why the engines and platforms are politely ignoring it (for now).
duaneforresterdecodes.substack.com/p/llmstxt-th...
llms.txt: The Web’s Next Great Idea, or Its Next Spam Magnet
A look at the promise, the risk, and the platform hesitation.
duaneforresterdecodes.substack.com
November 9, 2025 at 7:27 PM
Every decade the web invents a new way to say “Trust me.”
This time it’s llms.txt.
Here’s why the engines and platforms are politely ignoring it (for now).
duaneforresterdecodes.substack.com/p/llmstxt-th...
This time it’s llms.txt.
Here’s why the engines and platforms are politely ignoring it (for now).
duaneforresterdecodes.substack.com/p/llmstxt-th...
Working in what way?
Ahrefs published this recently: ahrefs.com/blog/llmstxt...
And even if the llms.txt file is hit, it doesn't mean it's used.
Ahrefs published this recently: ahrefs.com/blog/llmstxt...
And even if the llms.txt file is hit, it doesn't mean it's used.
We Analyzed 137K Sites: 97% of llms.txt Files Never Get Read
We analyzed 137K sites & found 97% of llms.txt files are never read. See why bots ignore these files & what this means for your AI visibility
ahrefs.com
July 15, 2026 at 3:23 PM
Working in what way?
Ahrefs published this recently: ahrefs.com/blog/llmstxt...
And even if the llms.txt file is hit, it doesn't mean it's used.
Ahrefs published this recently: ahrefs.com/blog/llmstxt...
And even if the llms.txt file is hit, it doesn't mean it's used.
🚀 Introducing llmstxt: Your Python tool for LLM-friendly code compression!
✨ Features:
• Smart code compression
• Multi-language support
• GitHub Actions integration
• Preserves semantic meaning
Try it: github.com/ngmisl/llmstxt
#Python #AI #OpenSource
✨ Features:
• Smart code compression
• Multi-language support
• GitHub Actions integration
• Preserves semantic meaning
Try it: github.com/ngmisl/llmstxt
#Python #AI #OpenSource
GitHub - ngmisl/llmstxt: A Python tool for compressing and organizing code files into a single, LLM-friendly text file. This tool is designed to help prepare codebases for analysis by Large Language M...
A Python tool for compressing and organizing code files into a single, LLM-friendly text file. This tool is designed to help prepare codebases for analysis by Large Language Models by removing unne...
github.com
December 19, 2024 at 10:40 AM
🚀 Introducing llmstxt: Your Python tool for LLM-friendly code compression!
✨ Features:
• Smart code compression
• Multi-language support
• GitHub Actions integration
• Preserves semantic meaning
Try it: github.com/ngmisl/llmstxt
#Python #AI #OpenSource
✨ Features:
• Smart code compression
• Multi-language support
• GitHub Actions integration
• Preserves semantic meaning
Try it: github.com/ngmisl/llmstxt
#Python #AI #OpenSource
November 17, 2025 at 5:39 PM
That would be nice really! I'd prefer the directory to be located very close to the llmstxt.org website. I sense though the maintenance overhead that comes with it, is not something that the maintainers of llmstxt want to take on.
November 22, 2024 at 1:11 PM
That would be nice really! I'd prefer the directory to be located very close to the llmstxt.org website. I sense though the maintenance overhead that comes with it, is not something that the maintainers of llmstxt want to take on.
FYI: llms.txt adoption rises 8.8x but 97% of files get zero AI requests #llmstxt #AImarketing #SEO #digitalmarketing #webanalytics
llms.txt adoption rises 8.8x but 97% of files get zero AI requests
Originality.ai counted 38,980 adopting sites across 3M+ websites by May 2026, yet SEO audit tools - not AI assistants - dominate actual llms.txt request logs.
ppc.land
July 5, 2026 at 7:20 PM
FYI: llms.txt adoption rises 8.8x but 97% of files get zero AI requests #llmstxt #AImarketing #SEO #digitalmarketing #webanalytics
there has been a cool explosion of llmstxt files online. i found a directory online llmstxt dot cloud. couldn't find a way to add to it so I scraped it and created llmstxt.site
you can add more by opening a PR to here github.com/krish-adi/ll...
you can add more by opening a PR to here github.com/krish-adi/ll...
A list if all the llms.txt based files location. Contribute to the repository below to add more locations.
llmstxt.site
November 21, 2024 at 6:51 PM
there has been a cool explosion of llmstxt files online. i found a directory online llmstxt dot cloud. couldn't find a way to add to it so I scraped it and created llmstxt.site
you can add more by opening a PR to here github.com/krish-adi/ll...
you can add more by opening a PR to here github.com/krish-adi/ll...
@szarnyasg.bsky.social rocks!
This completely deprecates my simple approach.
github.com/davidgasquez...
This completely deprecates my simple approach.
github.com/davidgasquez...
docs-to-llmstxt/docs/duckdb at main · davidgasquez/docs-to-llmstxt
🤖 Compile docs into text files for LLMs. Contribute to davidgasquez/docs-to-llmstxt development by creating an account on GitHub.
github.com
November 21, 2024 at 10:45 AM
@szarnyasg.bsky.social rocks!
This completely deprecates my simple approach.
github.com/davidgasquez...
This completely deprecates my simple approach.
github.com/davidgasquez...
though to be clear, llmstxt is written by humans, for machines
June 10, 2025 at 10:36 PM
though to be clear, llmstxt is written by humans, for machines
#Development #Introductions
Is your site ready for AI agents? · How Lighthouse’s new Agentic Browsing audit works ilo.im/16e7k3 by Dave Bitter
_____
#Lighthouse #AI #AiAgents #Accessibility #LlmsTxt #WebMCP #WebDev #Frontend
Is your site ready for AI agents? · How Lighthouse’s new Agentic Browsing audit works ilo.im/16e7k3 by Dave Bitter
_____
#Lighthouse #AI #AiAgents #Accessibility #LlmsTxt #WebMCP #WebDev #Frontend
Is your site ready for AI agents? Lighthouse now has an answer
Lighthouse added an Agentic Browsing category that measures how well your site works for user-facing AI agents, from llms.txt and WebMCP to accessibility and layout stability.
ilo.im
July 16, 2026 at 9:09 PM
#Development #Introductions
Is your site ready for AI agents? · How Lighthouse’s new Agentic Browsing audit works ilo.im/16e7k3 by Dave Bitter
_____
#Lighthouse #AI #AiAgents #Accessibility #LlmsTxt #WebMCP #WebDev #Frontend
Is your site ready for AI agents? · How Lighthouse’s new Agentic Browsing audit works ilo.im/16e7k3 by Dave Bitter
_____
#Lighthouse #AI #AiAgents #Accessibility #LlmsTxt #WebMCP #WebDev #Frontend
A researcher scanned 6,214 corporate domains and found 120 AI documentation files naming software packages nobody owned. He registered some. A Fortune 500 company's coding agent installed one within the hour. Vendor docs are now executable. Read the filing #aiagents #supplychain #llmstxt #AI
Your supplier
120 corporate sites published AI documentation naming unregistered packages. Researchers claimed some and agents installed them within an hour.
steelwise.uk
September 14, 2026 at 1:12 PM
A researcher scanned 6,214 corporate domains and found 120 AI documentation files naming software packages nobody owned. He registered some. A Fortune 500 company's coding agent installed one within the hour. Vendor docs are now executable. Read the filing #aiagents #supplychain #llmstxt #AI
llms.txt can’t tell an AI that Feature X was deprecated, or your pricing changed last month. It’s a flat list with no graph. When an AI gets those facts wrong in a vendor comparison, your brand absorbs the reputational cost. There’s a better way.
duaneforresterdecodes.substack.com/p/llmstxt-wa...
duaneforresterdecodes.substack.com/p/llmstxt-wa...
llms.txt Was Step One. Here’s the Architecture That Comes Next
A four-layer framework for giving AI agents clean, authoritative access to your brand
duaneforresterdecodes.substack.com
March 29, 2026 at 4:12 PM
llms.txt can’t tell an AI that Feature X was deprecated, or your pricing changed last month. It’s a flat list with no graph. When an AI gets those facts wrong in a vendor comparison, your brand absorbs the reputational cost. There’s a better way.
duaneforresterdecodes.substack.com/p/llmstxt-wa...
duaneforresterdecodes.substack.com/p/llmstxt-wa...
☕ WEB CHICK UPDATE
AI search is changing the web and this week we’re helping clients prepare for it.
This isn’t replacing SEO.
It’s preparing for the future of AI-powered search. ☕💻
#WebChickUpdate #AISearch #LLMSTXT #Accessibility #SchemaMarkup #WebDesign #FutureProofWebsites
AI search is changing the web and this week we’re helping clients prepare for it.
This isn’t replacing SEO.
It’s preparing for the future of AI-powered search. ☕💻
#WebChickUpdate #AISearch #LLMSTXT #Accessibility #SchemaMarkup #WebDesign #FutureProofWebsites
May 26, 2026 at 11:10 AM
☕ WEB CHICK UPDATE
AI search is changing the web and this week we’re helping clients prepare for it.
This isn’t replacing SEO.
It’s preparing for the future of AI-powered search. ☕💻
#WebChickUpdate #AISearch #LLMSTXT #Accessibility #SchemaMarkup #WebDesign #FutureProofWebsites
AI search is changing the web and this week we’re helping clients prepare for it.
This isn’t replacing SEO.
It’s preparing for the future of AI-powered search. ☕💻
#WebChickUpdate #AISearch #LLMSTXT #Accessibility #SchemaMarkup #WebDesign #FutureProofWebsites
FYI: Google adds llms.txt to Lighthouse as agentic web standards heat up #Google #llmsTxt #Lighthouse #SEO #WebStandards
Google adds llms.txt to Lighthouse as agentic web standards heat up
Google added llms.txt to Chrome Lighthouse agentic audits on May 5, 2026, reigniting debate among SEO and marketing professionals over the protocol's value.
ppc.land
June 2, 2026 at 4:45 AM
FYI: Google adds llms.txt to Lighthouse as agentic web standards heat up #Google #llmsTxt #Lighthouse #SEO #WebStandards
llms.txt v2 is out. Biggest change: discoverability via link relations - rel="alternate" for a page's markdown version, rel="describedby" for the llms.txt covering it. Also drops the llms_txt2ctx tool; agents now just follow links.
https://llmstxt.org/chan...
#llmstxt #aiseo
https://llmstxt.org/chan...
#llmstxt #aiseo
August 22, 2026 at 10:59 PM
llms.txt v2 is out. Biggest change: discoverability via link relations - rel="alternate" for a page's markdown version, rel="describedby" for the llms.txt covering it. Also drops the llms_txt2ctx tool; agents now just follow links.
https://llmstxt.org/chan...
#llmstxt #aiseo
https://llmstxt.org/chan...
#llmstxt #aiseo
FYI: Google adds llms.txt to Lighthouse as agentic web standards heat up #Google #llmsTxt #Lighthouse #SEO #WebStandards
Google adds llms.txt to Lighthouse as agentic web standards heat up
Google added llms.txt to Chrome Lighthouse agentic audits on May 5, 2026, reigniting debate among SEO and marketing professionals over the protocol's value.
ppc.land
June 2, 2026 at 4:42 AM
FYI: Google adds llms.txt to Lighthouse as agentic web standards heat up #Google #llmsTxt #Lighthouse #SEO #WebStandards