github/ai.robots.txt
1
0
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-12-29 12:18:33 +01:00
Code Issues Projects Releases Packages Wiki Activity

Commit graph

  • a6de89e6bd feat: make CCBot entry more accurate Greg Lindahl 2024-09-26 21:41:28 +00:00
  • 60bdfa7eb3
         Merge pull request #41 from cityrolr/patch-1 Cory Dransfeldt 2024-09-24 12:53:52 -07:00
  • af05890b07
         Update README.md Julian Mair 2024-09-23 23:27:27 +02:00
  • d2cd37442c
         Update table-of-bot-metrics.md Michael Davey 2024-09-23 22:26:05 +01:00
  • c1e6265ef4
         Update robots.json Michael Davey 2024-09-23 18:03:19 +01:00
  • 2c68b9a88b
         Update robots.txt Michael Davey 2024-09-23 17:59:44 +01:00
  • 0106d4b15a
         Add additional resource - README.md Urvish Patel 2024-09-23 08:19:27 -04:00
  • 1abf68b107
         Adding dataprovider.com's spider Gregory Hammond 2024-09-14 23:24:43 +00:00
  • 6b8d7f5890 Daily update from Dark Visitors ai.robots.txt 2024-09-09 01:16:21 +00:00
  • 5963cbf9f7 Daily update from Dark Visitors dark-visitors 2024-09-08 01:19:31 +00:00
  • b15b8062ce
         Merge pull request #36 from cramforce/patch-1 Glyn Normington 2024-09-08 01:26:07 +01:00
  • 809851ae88
         Add instructions for AI bot blocking on Vercel Malte Ubl 2024-09-07 15:59:25 -07:00
  • 1c1b423684 chore: add iaskspider/2.0 v1.16 ai.robots.txt 2024-09-07 02:05:43 +00:00
  • 8373294404
         chore: add iaskspider/2.0 Cory Dransfeldt 2024-09-06 19:05:26 -07:00
  • b30ca5f193
         Merge pull request #35 from nisbet-hubbard/patch-7 Cory Dransfeldt 2024-09-02 18:40:57 -07:00
  • fb5c995243 Daily update from Dark Visitors ai.robots.txt 2024-09-03 01:12:57 +00:00
  • 7151f6c569 Removing previously generated files ai.robots.txt 2024-09-03 01:12:56 +00:00
  • cc18b8617c
         Update main.yml nisbet-hubbard 2024-09-03 07:48:48 +08:00
  • c9325c9e18 Daily update from Dark Visitors ai.robots.txt 2024-09-02 01:15:07 +00:00
  • 567bd00aec Removing previously generated files ai.robots.txt 2024-09-02 01:15:07 +00:00
  • 543e993b08 Daily update from Dark Visitors ai.robots.txt 2024-09-01 01:24:53 +00:00
  • 01589718df Removing previously generated files ai.robots.txt 2024-09-01 01:24:52 +00:00
  • 9a7f556d87 Daily update from Dark Visitors ai.robots.txt 2024-08-31 01:13:04 +00:00
  • 9a4ebb57ee Removing previously generated files ai.robots.txt 2024-08-31 01:13:04 +00:00
  • 054c97ad4f Daily update from Dark Visitors ai.robots.txt 2024-08-30 01:13:29 +00:00
  • b2970316d8 Removing previously generated files ai.robots.txt 2024-08-30 01:13:29 +00:00
  • 008a34ceb4 chore: add ai2bot v1.15 ai.robots.txt 2024-08-29 03:07:52 +00:00
  • 3bce634e4a Removing previously generated files ai.robots.txt 2024-08-29 03:07:51 +00:00
  • 0f8723558f
         chore: add ai2bot Cory Dransfeldt 2024-08-28 20:07:32 -07:00
  • 6dc900b582 Daily update from Dark Visitors ai.robots.txt 2024-08-29 01:13:19 +00:00
  • 71eefcdb05 Removing previously generated files ai.robots.txt 2024-08-29 01:13:19 +00:00
  • 1d417ffab9 Daily update from Dark Visitors ai.robots.txt 2024-08-28 01:12:35 +00:00
  • 00ef18f93c Removing previously generated files ai.robots.txt 2024-08-28 01:12:35 +00:00
  • 84a2376f65 Daily update from Dark Visitors v1.14 ai.robots.txt 2024-08-27 01:12:20 +00:00
  • 699862f4bd Removing previously generated files ai.robots.txt 2024-08-27 01:12:19 +00:00
  • ccec3eef15 Daily update from Dark Visitors ai.robots.txt 2024-08-26 01:11:41 +00:00
  • 6cb9bc8ebf Removing previously generated files ai.robots.txt 2024-08-26 01:11:40 +00:00
  • 42a7ca7eda Daily update from Dark Visitors ai.robots.txt 2024-08-25 01:16:28 +00:00
  • 907866301f Removing previously generated files ai.robots.txt 2024-08-25 01:16:27 +00:00
  • b202b9e1e3 Daily update from Dark Visitors ai.robots.txt 2024-08-24 01:09:29 +00:00
  • ac1250cfa5 Removing previously generated files ai.robots.txt 2024-08-24 01:09:29 +00:00
  • d95f2e8072 Daily update from Dark Visitors ai.robots.txt 2024-08-23 01:10:54 +00:00
  • 61d851baf5 Removing previously generated files ai.robots.txt 2024-08-23 01:10:53 +00:00
  • 7bfc1647a8 Daily update from Dark Visitors dark-visitors 2024-08-22 01:11:43 +00:00
  • 3580a7096f Daily update from Dark Visitors ai.robots.txt 2024-08-21 01:10:11 +00:00
  • fad335178f Removing previously generated files ai.robots.txt 2024-08-21 01:10:10 +00:00
  • 358df0833e Daily update from Dark Visitors ai.robots.txt 2024-08-20 01:10:11 +00:00
  • 7e0dd921db Removing previously generated files ai.robots.txt 2024-08-20 01:10:11 +00:00
  • 591a99c320 Daily update from Dark Visitors ai.robots.txt 2024-08-19 01:11:49 +00:00
  • 394e447c78 Removing previously generated files ai.robots.txt 2024-08-19 01:11:49 +00:00
  • ab4a6547f6
         Merge branch 'main' of github.com:ai-robots-txt/ai.robots.txt Cory Dransfeldt 2024-08-18 11:34:47 -07:00
  • 1d3194f75d
         chore: update readme Cory Dransfeldt 2024-08-18 11:34:43 -07:00
  • 2363e57608
         chore: minor update Cory Dransfeldt 2024-08-18 11:34:08 -07:00
  • b8e68c12f3 Daily update from Dark Visitors ai.robots.txt 2024-08-18 01:14:50 +00:00
  • 60ff792ba9 Removing previously generated files ai.robots.txt 2024-08-18 01:14:49 +00:00
  • 3afcefdff5 Daily update from Dark Visitors ai.robots.txt 2024-08-17 01:08:17 +00:00
  • 558d5871b2 Removing previously generated files ai.robots.txt 2024-08-17 01:08:17 +00:00
  • 2a075cb2f1 Daily update from Dark Visitors ai.robots.txt 2024-08-16 01:10:14 +00:00
  • 3ef9cb7ce4 Removing previously generated files ai.robots.txt 2024-08-16 01:10:13 +00:00
  • 5937434aff Daily update from Dark Visitors dark-visitors 2024-08-15 01:07:15 +00:00
  • 407b9e12e6
         chore: sort output Cory Dransfeldt 2024-08-14 17:10:29 -07:00
  • bc66d10afd
         chore: update faq Cory Dransfeldt 2024-08-14 09:21:26 -07:00
  • df5b6ef647 Daily update from Dark Visitors ai.robots.txt 2024-08-14 01:11:03 +00:00
  • 2c8ed062b9 Removing previously generated files ai.robots.txt 2024-08-14 01:11:02 +00:00
  • 2e8e8af8e4 Daily update from Dark Visitors ai.robots.txt 2024-08-13 01:12:03 +00:00
  • f1d0c5b1fe Removing previously generated files ai.robots.txt 2024-08-13 01:12:02 +00:00
  • 53a39b2f71 Daily update from Dark Visitors ai.robots.txt 2024-08-12 01:12:23 +00:00
  • 274d48b8f0 Removing previously generated files ai.robots.txt 2024-08-12 01:12:23 +00:00
  • 6472e07f09 Daily update from Dark Visitors ai.robots.txt 2024-08-11 01:16:04 +00:00
  • cb98669cc2 Removing previously generated files ai.robots.txt 2024-08-11 01:16:03 +00:00
  • 7662d06eb3
         Merge pull request #33 from nisbet-hubbard/patch-6 Cory Dransfeldt 2024-08-09 19:42:36 -07:00
  • 53449ad1bd Daily update from Dark Visitors ai.robots.txt 2024-08-10 01:10:53 +00:00
  • 4242f8cc7b Removing previously generated files ai.robots.txt 2024-08-10 01:10:53 +00:00
  • 46540633ba
         Update README.md nisbet-hubbard 2024-08-10 08:22:28 +08:00
  • 21e5cd96a9 Daily update from Dark Visitors ai.robots.txt 2024-08-09 01:11:12 +00:00
  • ed7d7d3fdf Removing previously generated files ai.robots.txt 2024-08-09 01:11:11 +00:00
  • 57f006150b Daily update from Dark Visitors ai.robots.txt 2024-08-08 01:10:13 +00:00
  • 40f9325a4f Removing previously generated files ai.robots.txt 2024-08-08 01:10:12 +00:00
  • 0122dea1e9 Merge pull request #32 from ChenghaoMou/main ai.robots.txt 2024-08-07 22:40:24 +00:00
  • 663b85cc07 Removing previously generated files ai.robots.txt 2024-08-07 22:40:24 +00:00
  • 5c8b4593f4
         Merge pull request #32 from ChenghaoMou/main Adam Newbold 2024-08-07 18:40:13 -04:00
  • 6f96795edc restore cron Chenghao Mou 2024-08-07 12:43:44 +01:00
  • ab17662f96 Daily update from Dark Visitors ai.robots.txt 2024-08-07 11:41:00 +00:00
  • 8738c66c65 Removing previously generated files ai.robots.txt 2024-08-07 11:40:59 +00:00
  • b00067bc86 restore files deleted by failed workflow and fix main commit message Chenghao Mou 2024-08-07 12:36:21 +01:00
  • 4a63c482c4 Removing previously generated files ai.robots.txt 2024-08-07 11:31:02 +00:00
  • 366e49dc6d restore files deleted by failed workflow and fix main commit message Chenghao Mou 2024-08-07 12:21:40 +01:00
  • aaa55594e1 Removing previously generated files ai.robots.txt 2024-08-07 11:13:16 +00:00
  • fbebbbfefb restore files deleted by failed workflow Chenghao Mou 2024-08-07 12:02:46 +01:00
  • 6a275366be Daily update from Dark Visitors dark-visitors 2024-08-07 10:50:45 +00:00
  • 09c6b78b46 fix job dependency Chenghao Mou 2024-08-07 11:45:37 +01:00
  • d4f34363ec Removing previously generated files ai.robots.txt 2024-08-07 10:40:50 +00:00
  • 30eaff1447 call main after update ai.robots.txt 2024-08-07 10:32:13 +00:00
  • bd3eee7a30 Removing previously generated files ai.robots.txt 2024-08-07 10:32:12 +00:00
  • 944bee0f56 call main after update Chenghao Mou 2024-08-07 11:31:58 +01:00
  • cebf809391 Daily update from Dark Visitors dark-visitors 2024-08-07 00:14:26 +00:00
  • 3d4bf2c3db restore original robots.json ai.robots.txt 2024-08-06 18:50:54 +00:00
  • d6a5e8cd81 Removing previously generated files ai.robots.txt 2024-08-06 18:50:53 +00:00
  • 4cf82b703f restore original robots.json Chenghao Mou 2024-08-06 19:50:38 +01:00
  • 0b6eba8dd5 skip push if no change Chenghao Mou 2024-08-06 19:40:43 +01:00