# Arc en Ciel LLM Crawling Policy
Site: https://arcenciel.io
Last-Updated: 2026-02-19

Allow:
- Public list and detail pages for models, images, videos, articles, collections, and user profiles.
- Public metadata such as titles, descriptions, tags, uploader names, and public comments.
- Public media assets under /uploads/.
- Public bot-rendered metadata routes under /meta/.
- Public crawl-focused metadata routes under /meta/crawl/.
- Sitemap discovery via /sitemap.xml and /sitemaps/*.xml.
- Discovery manifest via /.well-known/ai-discovery.json.

Disallow:
- Authentication and account flows under /auth/.
- API routes under /api/ and docs routes under /api-docs and /api/admin-docs.
- Internal and infrastructure paths such as /_internal/, /stub_status, /metrics, and /cdn-cgi/.
- Any non-public content, including private collections, unpublished drafts, deleted content, banned users, and moderator/admin-only data.

Notes:
- If a resource is not publicly accessible in the web app, treat it as disallowed for crawling and indexing.
- Prefer canonical page URLs and sitemap links when discovering content.