Skip to content
Orino Docs

OAI-SearchBot blocked in robots.txt (HTML project)

What this means

Section titled “What this means”

Orino found Disallow: / under User-agent: OAI-SearchBot in your project’s robots.txt file. OAI-SearchBot is ChatGPT’s real-time web search crawler. Blocking it means your site cannot appear in ChatGPT’s web-search-powered answers once deployed.

This check runs during disk-only audits — when Orino scans a plain HTML project without fetching a live URL. It reads the robots.txt file directly from your project directory.

How to fix it

Section titled “How to fix it”

Open robots.txt in your project root and remove the OAI-SearchBot block:

# Remove these lines
User-agent: OAI-SearchBot
Disallow: /

To allow OAI-SearchBot site-wide, delete both lines. To exclude specific paths:

User-agent: OAI-SearchBot
Disallow: /internal/

Verify the fix

Section titled “Verify the fix”

Check the file in your project:

Terminal window
grep -A 3 "OAI-SearchBot" robots.txt

No output means OAI-SearchBot falls back to your wildcard rules. Disallow: / means it is still blocked. Re-run orino audit to confirm the check passes.

Section titled “Related fixes”