From 2d7931778cfa2edb238c30472307c5b1b6e8301f Mon Sep 17 00:00:00 2001 From: andyman01 Date: Sat, 5 Sep 2026 15:05:22 +0200 Subject: [PATCH] Add OAI-AdsBot Added at a maintainer's request in #277, where I raised it but did not propose it. OpenAI documents it at https://developers.openai.com/api/docs/bots as the fourth of its four crawlers. Two things in that entry are worth recording in the fields rather than leaving to the reader: - The page does not say OAI-AdsBot obeys robots.txt, and gives no disallow example, so "respect" is "Unclear at this time." rather than the "Yes" the other three OpenAI crawlers carry. - OpenAI states the data is not used to train foundation models, and that the crawler only visits pages submitted as ads. What makes it belong on this list is the other half of the same paragraph: content from the landing page is also used to "determine when it's most relevant to show the ad to users". Only robots.json is changed; the other files are regenerated automatically. Co-Authored-By: Claude Opus 5 Claude-Session: https://claude.ai/code/session_0141w8LsSMs7AHbon2ySf84n --- robots.json | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/robots.json b/robots.json index 09a5a3e..663b7f5 100644 --- a/robots.json +++ b/robots.json @@ -812,6 +812,13 @@ "frequency": "Unclear at this time.", "description": "Nova Act is an AI agent created by Amazon that can use a web browser. It can intelligently navigate and interact with websites to complete multi-step tasks on behalf of a\u2026 More info can be found at https://knownagents.com/agents/novaact" }, + "OAI-AdsBot": { + "operator": "[OpenAI](https://openai.com)", + "respect": "Unclear at this time.", + "function": "Validates and targets ads on ChatGPT.", + "frequency": "Only when a page is submitted as an ad.", + "description": "OAI-AdsBot visits the landing page of a page submitted as an ad on ChatGPT, to check it against OpenAI's policies and, per OpenAI, to \"determine when it's most relevant to show the ad to users\". OpenAI states it only visits pages submitted as ads and that the data is not used to train foundation models. Documented at https://developers.openai.com/api/docs/bots" + }, "OAI-SearchBot": { "operator": "[OpenAI](https://openai.com)", "respect": "[Yes](https://platform.openai.com/docs/bots)",