github/ai.robots.txt
1
0
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-12-29 12:18:33 +01:00
Code Issues Projects Releases Packages Wiki Activity

Added YaK user-agent to list of robots

Browse source 
Added Meltwater's AI to list of bots that use AI and scrape websites.
This commit is contained in:
Gregory 2025-07-26 23:50:11 -04:00
commit 8b188d0612
1 changed files with 7 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

7
robots.json
View file

@ -587,6 +587,13 @@
"frequency": "Unclear at this time.", "frequency": "Unclear at this time.",
"description": "wpbot is a used to support the functionality of the AI Chatbot for WordPress plugin. It supports the use of customer models, data collection and customer support." "description": "wpbot is a used to support the functionality of the AI Chatbot for WordPress plugin. It supports the use of customer models, data collection and customer support."
}, },
"YaK": {
"operator": "[Meltwater](https://www.meltwater.com/en/suite/consumer-intelligence)",
"respect": "Unclear at this time.",
"function": "By applying AI, data science, and market research expertise to a live feed of global data sources, we transform unstructured data into actionable insights allowing better decision-making."
"frequency": "Unclear at this time.",
"description": "Retrieves data used for Meltwater's AI enabled consumer intelligence suite"
},
"YandexAdditional": { "YandexAdditional": {
"operator": "[Yandex](https://yandex.ru)", "operator": "[Yandex](https://yandex.ru)",
"respect": "[Yes](https://yandex.ru/support/webmaster/en/search-appearance/fast.html?lang=en)", "respect": "[Yes](https://yandex.ru/support/webmaster/en/search-appearance/fast.html?lang=en)",