remote/ai.robots.txt
1
0
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2026-08-30 04:44:06 +02:00
Code Issues Projects Releases Packages Wiki Activity

Merge pull request #262 from farrelldan/add-bot-ledger-related

Browse source 
Add Bot Ledger to Related resources
This commit is contained in:
Glyn Normington 2026-08-16 04:02:44 +01:00 • committed by GitHub
commit dd30b585f4
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
README.md
View file

@ -47,6 +47,9 @@ middleware plugin for [Traefik](https://traefik.io/traefik/) to automatically ad
file on-the-fly.
- Alternatively you can [manually configure Traefik](./docs/traefik-manual-setup.md) to centrally serve a static `robots.txt`.
- [Bot Ledger](https://farrelldan.github.io/ai-bot-directory/): free, static directory of verified AI crawlers with a one-click `robots.txt` and `llms.txt` generator. No signup required.
## Contributing
A note about contributing: updates should be added/made to `robots.json`. A GitHub action will then generate the updated `robots.txt`, `table-of-bot-metrics.md`, `.htaccess` and `nginx-block-ai-bots.conf`.