github/ai.robots.txt
1
0
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-12-29 12:18:33 +01:00
Code Issues Projects Releases Packages Wiki Activity

Merge pull request #200 from glyn/deepseek

Browse source 
Clarify that DeepSeekBot does not respect robots.txt
This commit is contained in:
Glyn Normington 2025-11-27 14:00:40 +00:00 • committed by GitHub
commit 4467002298
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
robots.json
View file

@ -239,7 +239,7 @@
},
"DeepSeekBot": {
"operator": "DeepSeek",
"respect": "Unclear at this time.",
"respect": "No",
"function": "Training language models and improving AI products",
"frequency": "Unclear at this time.",
"description": "DeepSeekBot is a web crawler used by DeepSeek to train its language models and improve its AI products."