github/ai.robots.txt
1
0
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-12-29 12:18:33 +01:00
Code Issues Projects Releases Packages Wiki Activity

Commit graph

  • dea035365f
         chore: add Diffbot and scoopit Cory Dransfeldt 2024-05-05 14:50:04 -07:00
  • 29e0799332
         chore: add img2dataset to table-of-bot-metrics.md Cory Dransfeldt 2024-04-22 09:30:00 -07:00
  • 5025939e5d
         chore: add img2dataset to edge func Cory Dransfeldt 2024-04-22 09:28:39 -07:00
  • 8ddd2a0bb3
         chore: add img2dataset to nginx.conf Cory Dransfeldt 2024-04-22 09:28:21 -07:00
  • 2b77b0b0ad
         chore: add img2dataset to apache.conf Cory Dransfeldt 2024-04-22 09:27:41 -07:00
  • 118ec00126
         chore: add img2dataset to robots.txt Cory Dransfeldt 2024-04-22 09:26:59 -07:00
  • 6f1a28e17a
         chore: update nginx Cory Dransfeldt 2024-04-16 08:20:32 -07:00
  • 1664980617
         chore: comment Cory Dransfeldt 2024-04-14 10:04:25 -07:00
  • 1e91744ed2
         feat: add edge function Cory Dransfeldt 2024-04-14 10:03:40 -07:00
  • 9a92568266
         Merge branch 'main' of github.com:ai-robots-txt/ai.robots.txt Cory Dransfeldt 2024-04-14 09:56:30 -07:00
  • 9d56001747
         chore: move server configs Cory Dransfeldt 2024-04-14 09:56:23 -07:00
  • d05a6956b8
         Create FUNDING.yml Cory Dransfeldt 2024-04-12 11:40:44 -07:00
  • 0d9b75b227
         chore: move additional resources to wiki Cory Dransfeldt 2024-04-12 09:33:19 -07:00
  • 9be338094b
         chore: populate gptbot Cory Dransfeldt 2024-04-10 10:53:16 -07:00
  • ef5d847e65
         chore: add gitignore; move logo file Cory Dransfeldt 2024-04-10 10:44:07 -07:00
  • cc5966af5f
         chore: populate ChatGPT-User Cory Dransfeldt 2024-04-10 10:39:34 -07:00
  • 0a8952b34f
         chore: add applebot Cory Dransfeldt 2024-04-10 10:18:51 -07:00
  • b402ec681c
         chore: add anthropic + amazonbot Cory Dransfeldt 2024-04-10 10:15:22 -07:00
  • 46b0532daf
         Merge pull request #8 from mattlinares/feature/add-table-of-crawler-detail Cory Dransfeldt 2024-04-10 09:08:22 -07:00
  • db06035714
         Merge branch 'main' into feature/add-table-of-crawler-detail Cory Dransfeldt 2024-04-10 09:07:45 -07:00
  • aa0edf05b3 Add Google Gemini response on AbsBot-Google for bot metrics table. Matthew Linares 2024-04-10 15:40:33 +01:00
  • b6be895994
         fix: clean up syntax Cory Dransfeldt 2024-04-09 16:08:57 -07:00
  • ed190d4803
         fix: syntax Cory Dransfeldt 2024-04-09 16:08:13 -07:00
  • 0518b3e777
         chore: add FriendlyCrawler to the table Cory Dransfeldt 2024-04-08 12:50:36 -07:00
  • 964b29d330
         Merge pull request #6 from mattlinares/main Cory Dransfeldt 2024-04-08 12:48:35 -07:00
  • e03d5f4ec2
         chore: add FriendlyCrawler to nginx.conf.txt Cory Dransfeldt 2024-04-08 12:41:40 -07:00
  • 2d4efec184
         chore: add FriendlyCrawler to apache.conf.txt Cory Dransfeldt 2024-04-08 12:41:19 -07:00
  • d6d40989f4
         chore: add FriendlyCrawler to robots.txt Cory Dransfeldt 2024-04-08 12:40:59 -07:00
  • 048045ac6d Adds table of bot details and metrics. Matthew Linares 2024-04-08 20:29:45 +01:00
  • 74e4f64d89
         chore: create nginx.conf.txt Cory Dransfeldt 2024-04-08 12:27:59 -07:00
  • 609de2af12
         chore: create apache.conf.txt Cory Dransfeldt 2024-04-08 12:26:04 -07:00
  • 47fc45f2f9
         chore: add PiplBot Cory Dransfeldt 2024-04-06 20:25:28 -07:00
  • 46c8c9adb3
         chore: add Meltwater Cory Dransfeldt 2024-04-03 08:56:30 -07:00
  • c8a6d7f02d
         chore: add Seekr Cory Dransfeldt 2024-04-03 08:56:12 -07:00
  • bdf10968fd
         chore: add ai.txt Cory Dransfeldt 2024-04-01 09:56:10 -07:00
  • d7064d23fe
         chore: additional resources Cory Dransfeldt 2024-04-01 09:55:46 -07:00
  • 5e02ebc168
         chore: update README Cory Dransfeldt 2024-03-29 12:14:48 -07:00
  • 2d1c4707aa
         Merge pull request #2 from Explosion-Scratch/patch-1 Cory Dransfeldt 2024-03-28 09:15:51 -07:00
  • 3e57b5ab5d
         Add GoogleOther --Explosion-- 2024-03-28 10:00:58 -05:00
  • 543dfc8452
         Merge pull request #1 from glyn/logo Cory Dransfeldt 2024-03-28 07:26:14 -07:00
  • 780d772d53 Scale down logo Glyn Normington 2024-03-28 09:11:49 +00:00
  • 290d603b06 Reduce logo size Glyn Normington 2024-03-28 09:09:29 +00:00
  • a71da3ecc4 Add logo Glyn Normington 2024-03-28 09:06:46 +00:00
  • 297071a664
         Update robots.txt Cory Dransfeldt 2024-03-27 11:41:12 -07:00
  • 8aeddbdce8
         Create robots.txt Cory Dransfeldt 2024-03-27 10:59:01 -07:00
  • be9d22abed
         Create README.md Cory Dransfeldt 2024-03-27 10:58:49 -07:00
  • 400e0141db
         Initial commit Cory Dransfeldt 2024-03-27 10:48:29 -07:00