User-agent: * Allow: / Disallow: /admin Disallow: /admin/ Disallow: /api/ Disallow: /_next/ # /material/:id and /community render their content client-side by fetching the # material READ endpoints (/api/materials, /api/materials/:id, .../map/..., # .../asset/...). Google's renderer obeys robots.txt for those fetches, so with # /api/ fully disallowed the data never loads and every page renders an empty # "Loading…" shell → Soft 404. Allow the material read endpoints (broader Allow # overrides the /api/ Disallow); the JSON responses carry X-Robots-Tag: noindex # so the endpoints themselves aren't indexed, while preview/map images stay # indexable for image search. Everything else under /api/ stays blocked. Allow: /api/materials Sitemap: https://craftpbr.com/sitemap.xml Sitemap: https://craftpbr.com/sitemap-materials.xml Host: https://craftpbr.com