mirror of
https://github.com/ai-robots-txt/ai.robots.txt.git
synced 2025-12-29 12:18:33 +01:00
parent
44e58a5ece
commit
27420d6fed
6 changed files with 6 additions and 3 deletions
|
|
@ -82,6 +82,7 @@ User-agent: VelenPublicWebCrawler
|
|||
User-agent: WARDBot
|
||||
User-agent: Webzio-Extended
|
||||
User-agent: wpbot
|
||||
User-agent: YaK
|
||||
User-agent: YandexAdditional
|
||||
User-agent: YandexAdditionalBot
|
||||
User-agent: YouBot
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue