Skip to content
DarkSeek API developer preview. View supported features and launch status
darkseekAPI Docs

Context caching

View Markdown ↗

Understand cache reuse and measured cache-hit pricing.

Physical cache#

The serving runtime may reuse compatible prompt prefixes in GPU KV cache. This is a runtime scheduling optimization, not durable storage or an account entitlement. Reuse depends on model, prefix, pressure and placement.

Accounting boundary#

The published Models & pricing schedule distinguishes cache-hit and cache-miss input tokens. Do not infer cache-hit token counts from repeated prompts or faster latency. Applying the cache-hit rate requires measured upstream cache usage and reconciled accounting. No cache hit rate is guaranteed, and automated billing is not enabled yet.