Skip to main content

​
Prompt caching

Prompt caching means the model provider can reuse unchanged prompt prefixes (usually system/developer instructions and other stable context) across turns instead of re-processing them every time. The first matching request writes cache tokens (cacheWrite), and later matching requests can read them back (cacheRead). Why this matters: lower token cost, faster responses, and more predictable performance for long-running sessions. Without caching, repeated prompts pay the full prompt cost on every turn even when most input did not change. This page covers all cache-related knobs that affect prompt reuse and token cost. For provider-specific cache behavior and current pricing, check the provider docs: https://docs.anthropic.com/docs/build-with-claude/prompt-caching

​
Primary knobs

​
cacheRetention (model and per-agent)

Set cache retention on model params: 
agents:
  defaults:
    models:
      "anthropic/claude-opus-4-6":
        params:
          cacheRetention: "short" # none | short | long
Per-agent override: 
agents:
  list:
    - id: "alerts"
      params:
        cacheRetention: "none"
Config merge order:
  1. agents.defaults.models["provider/model"].params
  2. agents.list[].params (matching agent id; overrides by key)

​
Legacy cacheControlTtl

Legacy values are still accepted and mapped:
  • 5m -> short
  • 1h -> long
Prefer cacheRetention for new config.

​
contextPruning.mode: "cache-ttl"

Prunes old tool-result context after cache TTL windows so post-idle requests do not re-cache oversized history. 
agents:
  defaults:
    contextPruning:
      mode: "cache-ttl"
      ttl: "1h"
See Session Pruning for full behavior.

​
Heartbeat keep-warm

Heartbeat can keep cache windows warm and reduce repeated cache writes after idle gaps. 
agents:
  defaults:
    heartbeat:
      every: "55m"
Per-agent heartbeat is supported at agents.list[].heartbeat.

​
Provider behavior

​
Anthropic (direct API)

  • cacheRetention is supported.
  • With Anthropic API-key auth profiles, Fased seeds cacheRetention: "short" for Anthropic model refs when unset.

​
OpenRouter Anthropic models

For openrouter/anthropic/* model refs, Fased injects Anthropic cache_control on system/developer prompt blocks to improve prompt-cache reuse.

​
Other providers

If the provider does not support this cache mode, cacheRetention has no effect.

​
Tuning patterns

Keep a long-lived baseline on your main agent, disable caching on bursty notifier agents: 
agents:
  defaults:
    model:
      primary: "anthropic/claude-opus-4-6"
    models:
      "anthropic/claude-opus-4-6":
        params:
          cacheRetention: "long"
  list:
    - id: "research"
      default: true
      heartbeat:
        every: "55m"
    - id: "alerts"
      params:
        cacheRetention: "none"

​
Cost-first baseline

  • Set baseline cacheRetention: "short".
  • Enable contextPruning.mode: "cache-ttl".
  • Keep heartbeat below your TTL only for agents that benefit from warm caches.

​
Cache diagnostics

Fased exposes dedicated cache-trace diagnostics for embedded agent runs.

​
diagnostics.cacheTrace config

diagnostics:
  cacheTrace:
    enabled: true
    filePath: "~/.fased/logs/cache-trace.jsonl" # optional
    includeMessages: false # default true
    includePrompt: false # default true
    includeSystem: false # default true
Defaults:
  • filePath: $FASED_STATE_DIR/logs/cache-trace.jsonl
  • includeMessages: true
  • includePrompt: true
  • includeSystem: true

​
Env toggles (one-off debugging)

  • FASED_CACHE_TRACE=1 enables cache tracing.
  • FASED_CACHE_TRACE_FILE=/path/to/cache-trace.jsonl overrides output path.
  • FASED_CACHE_TRACE_MESSAGES=0|1 toggles full message payload capture.
  • FASED_CACHE_TRACE_PROMPT=0|1 toggles prompt text capture.
  • FASED_CACHE_TRACE_SYSTEM=0|1 toggles system prompt capture.

​
What to inspect

  • Cache trace events are JSONL and include staged snapshots like session:loaded, prompt:before, stream:context, and session:after.
  • Per-turn cache token impact is visible in the Control UI Usage page via cacheRead and cacheWrite.
  • Chat /usage full can still show a per-response footer for the current session, but the Usage page is the better history view for provider/model/accounting review.
  • Cache trace files are operator diagnostics; use Logs or Advanced > Debug when you need raw trace inspection.

​
Quick troubleshooting

  • High cacheWrite on most turns: check for volatile system-prompt inputs and verify model/provider supports your cache settings.
  • No effect from cacheRetention: confirm model key matches agents.defaults.models["provider/model"].
  • Configured providers without compatible cache support may ignore Fased cache settings or show no cache-token effect. Bedrock-compatible Anthropic model configs can pass explicit cacheRetention when configured through Advanced Config or a custom provider block.
Related docs: