Skip to content

Applebot-Extended blocked in robots.txt

Your robots.txt has Disallow: / under User-agent: Applebot-Extended. Applebot-Extended controls whether content Applebot has already fetched may be used to train Apple’s foundation models, which power Apple Intelligence. Applebot itself, which powers Siri and Spotlight search, is unaffected.

This is reported as Info and does not affect your score: opting out of model training is a legitimate choice. Leave the block in place if it was deliberate.

Remove the Applebot-Extended block from your robots.txt:

# Remove these lines
User-agent: Applebot-Extended
Disallow: /

To keep Applebot-Extended out of specific sections only, disallow those paths instead:

User-agent: Applebot-Extended
Disallow: /private/

If Applebot-Extended is listed alongside other agents in a grouped block (several User-agent lines followed by one Disallow: /), remove just its User-agent line.

After deploying:

Terminal window
curl -s https://yourdomain.com/robots.txt | grep -A 3 "Applebot-Extended"

No result means Applebot-Extended falls back to your wildcard rules. Disallow: / means the block is still active. Re-run orino audit to confirm the check passes.