Search results

Agentic web browser sniffing (gray area)

enhancementNew feature or requestNew feature or request

questionFurther information is requestedFurther information is requested

Status: Open.

#162 In ai-robots-txt/ai.robots.txt;

· jaredcwhite opened on Jul 18, 2025

Avoid duplicated entries in robots.json

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#144 In ai-robots-txt/ai.robots.txt;

· glyn opened on Jun 4, 2025

Bingbot Quandry

Status: Open.

#111 In ai-robots-txt/ai.robots.txt;

· dennislee1 opened on Apr 23, 2025

Bytespider and robots.txt

bugSomething isn't workingSomething isn't working

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#108 In ai-robots-txt/ai.robots.txt;

· dennislee1 opened on Apr 20, 2025

Expand explanation of .htaccess implementation in readme

documentationImprovements or additions to documentationImprovements or additions to documentation

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#106 In ai-robots-txt/ai.robots.txt;

· splorp opened on Apr 17, 2025

Blocking Opedia?

Status: Open.

#77 In ai-robots-txt/ai.robots.txt;

· juliemoynat opened on Feb 14, 2025

Blocking Bytedance "hidden" AI bot

Status: Open.

#69 In ai-robots-txt/ai.robots.txt;

· bohwaz opened on Jan 9, 2025

Test dark visitors update and improve code/test_files/robots.json

good first issueGood for newcomersGood for newcomers

Status: Open.

#52 In ai-robots-txt/ai.robots.txt;

· glyn opened on Oct 20, 2024