github/ai.robots.txt
1
0
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-12-29 12:18:33 +01:00
Code Issues Projects Releases Packages Wiki Activity

Update from Dark Visitors

Browse source
This commit is contained in:
ai.robots.txt 2025-03-29 00:54:10 +00:00
commit 5b8650b99b
3 changed files with 4 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

1
robots.txt
View file

@ -35,6 +35,7 @@ User-agent: omgili
User-agent: omgilibot
User-agent: PanguBot
User-agent: PerplexityBot
User-agent: Perplexity‑User
User-agent: PetalBot
User-agent: Scrapy
User-agent: SemrushBot-OCOB