remote/ai.robots.txt
1
0
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2026-06-03 07:36:56 +02:00
Code Issues Projects Releases Packages Wiki Activity

chore: suppress expected robot-name normalization noise

Browse source
This commit is contained in:
shuofengzhang 2026-03-15 13:34:40 +00:00
commit c223c8bced
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
code/robots.py
View file

@ -124,8 +124,8 @@ def clean_robot_name(name):
# actually uses a non-breaking hyphen, but that seems unlikely,
# so this solution should be fine for now.
result = re.sub(r"\u2011", "-", name)
if result != name:
print(f"\tCleaned '{name}' to '{result}' - unicode/html mangled chars normalized.")
# Normalization is expected for known source quirks (e.g. non-breaking hyphen),
# so keep this path quiet to avoid noisy CI output.
return result