Skip to content

/_astro/ blocked in robots.txt

Astro outputs all compiled JavaScript and CSS under /_astro/. A Disallow: /_astro/ rule in robots.txt tells Googlebot not to fetch those files. Without them, Googlebot cannot render your pages. They appear blank in Google’s renderer and are indexed with no content.

Remove the Disallow: /_astro/ rule. If there are other paths you need to block, list them specifically.

User-agent: *
Allow: /
Sitemap: https://example.com/sitemap-index.xml

If you copied a robots.txt template from a different framework (for example /_next/ for Next.js or /_nuxt/ for Nuxt), remove that line — it is irrelevant in an Astro project.

Terminal window
curl https://yourdomain.com/robots.txt

Confirm there is no Disallow: /_astro/ line. Then re-run orino audit.