# Arc en Ciel LLM Crawling Policy
Site: https://arcenciel.io
Last-Updated: 2026-07-02

Allow:
- Public list and detail pages for models, images, videos, articles, collections, and user profiles that are visible without authentication.
- Public metadata such as titles, descriptions, tags, uploader names, and public comments on content that is visible without authentication.
- Public media assets under /uploads/ only when those assets are part of publicly visible content.
- Public bot-rendered metadata routes under /meta/ when they return 200 and indexable robots headers.
- Public crawl-focused metadata routes under /meta/crawl/ for discovery, list pages, and structured site snapshots.
- Public API documentation under /api-docs/.
- Stable Developer Platform documentation under /developers, including the five-minute quickstart, compatibility policy, and official SDK links.
- Standalone, statically crawlable Developer API quickstart under /developers/quickstart with exact npm, PyPI, TypeScript, Python, and cURL examples.
- Official SDK compatibility and installation guide under /developers/sdks with package homepages, runtime support, signed source tags, and immutable contract links.
- Deterministic Developer Sandbox documentation under /developers/sandbox. The sandbox uses fixed public test credentials and never persists writes.
- Immutable Developer API contracts and release compatibility under /developers/openapi/releases.json.
- Public Help Center and wiki content under /help/ and the /wiki alias.
- Public trust, security, model-safety, status-summary, changelog, roadmap, legal, and moderation-policy pages.
- Sitemap discovery via /sitemap.xml and /sitemaps/*.xml.
- Discovery manifest via /.well-known/ai-discovery.json.
- Vulnerability disclosure contact via /.well-known/security.txt.

Disallow:
- Authentication and account flows under /auth/.
- API routes under /api/ and admin docs routes under /api/admin-docs.
- Internal and infrastructure paths such as /_internal/, /stub_status, /metrics, and /cdn-cgi/.
- Any non-public content, including private collections, unpublished drafts, deleted content, banned users, moderator/admin-only data, and guest-blocked sensitive or explicit detail pages.

Notes:
- If a resource is not publicly accessible in the web app, treat it as disallowed for crawling and indexing.
- Prefer canonical page URLs and sitemap links when discovering content.
- Sensitive or explicit public content may be available only to logged-in users or explicit-content hosts; when the public route returns 404 or noindex, do not index it from metadata or uploads.

Developer Platform:
- Portal: https://arcenciel.io/developers
- Five-minute quickstart: https://arcenciel.io/developers/quickstart
- Official SDKs: https://arcenciel.io/developers/sdks
- API reference: https://arcenciel.io/developers/reference/
- OpenAPI releases: https://arcenciel.io/developers/openapi/releases.json
- Sandbox: https://arcenciel.io/developers/sandbox
- Webhook reference: https://arcenciel.io/developers/webhooks/reference
- TypeScript SDK: npm install @arcenciel/sdk — https://www.npmjs.com/package/@arcenciel/sdk
- Python SDK: python3.11 -m pip install arcenciel — https://pypi.org/project/arcenciel/
- SDK source, compatibility, and signed tags: https://github.com/FallenIncursio/arcenciel-sdks