github/ai.robots.txt
1
0
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-12-29 12:18:33 +01:00
Code Issues Projects Releases Packages Wiki Activity

Description is third party, not first

Browse source
This commit is contained in:
Glyn Normington 2025-10-21 01:08:42 +01:00 • committed by GitHub
commit d22b8dfd7b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
robots.json
View file

@ -375,7 +375,7 @@
"respect": "Yes", "respect": "Yes",
"function": "Search result generation.", "function": "Search result generation.",
"frequency": "Unclear at this time.", "frequency": "Unclear at this time.",
"description": "Ibou.io operates a crawler service named IbouBot which fuels and updates our graph representation of the World Wide Web. This database and all the metrics are used to provide a search engine." "description": "Ibou.io operates a crawler service named IbouBot which fuels and updates their graph representation of the World Wide Web. This database and all the metrics are used to provide a search engine."
}, },
"ICC-Crawler": { "ICC-Crawler": {
"operator": "[NICT](https://nict.go.jp)", "operator": "[NICT](https://nict.go.jp)",