Session Management & Compaction (Deep Dive)
This document explains how Fased manages sessions end-to-end:- Session routing (how inbound messages map to a
sessionKey) - Session store (
sessions.json) and what it tracks - Transcript persistence (
*.jsonl) and its structure - Transcript hygiene (provider-specific fixups before runs)
- Context limits (context window vs tracked tokens)
- Compaction (manual + auto-compaction) and where to hook pre-compaction work
- Silent housekeeping (e.g. memory writes that shouldn’t produce user-visible output)
Source of truth: the Gateway
Fased is designed around a single Gateway process that owns session state.- UIs (macOS app, web Control UI, TUI) should query the Gateway for session lists and token counts.
- In remote mode, session files are on the remote host; “checking your local Mac files” won’t reflect what the Gateway is using.
Two persistence layers
Fased persists sessions in two layers:-
Session store (
sessions.json)- Key/value map:
sessionKey -> SessionEntry - Small, mutable, safe to edit (or delete entries)
- Tracks session metadata (current session id, last activity, toggles, token counters, etc.)
- Key/value map:
-
Transcript (
<sessionId>.jsonl)- Append-only transcript with tree structure (entries have
id+parentId) - Stores the actual conversation + tool calls + compaction summaries
- Used to rebuild the model context for future turns
- Append-only transcript with tree structure (entries have
On-disk locations
Per agent, on the Gateway host:- Store:
~/.fased/agents/<agentId>/sessions/sessions.json - Transcripts:
~/.fased/agents/<agentId>/sessions/<sessionId>.jsonl- Telegram topic sessions:
.../<sessionId>-topic-<threadId>.jsonl
- Telegram topic sessions:
src/config/sessions.ts.
Store maintenance and disk controls
Session persistence has automatic maintenance controls (session.maintenance) for sessions.json and transcript artifacts:
mode:warn(default) orenforcepruneAfter: stale-entry age cutoff (default30d)maxEntries: cap entries insessions.json(default500)rotateBytes: rotatesessions.jsonwhen oversized (default10mb)resetArchiveRetention: retention for*.reset.<timestamp>transcript archives. Defaults to the same value aspruneAfter;falsedisables cleanup.maxDiskBytes: optional sessions-directory budgethighWaterBytes: optional target after cleanup (default80%ofmaxDiskBytes)
mode: "enforce"):
- Remove oldest archived or orphan transcript artifacts first.
- If still above the target, evict oldest session entries and their transcript files.
- Keep going until usage is at or below
highWaterBytes.
mode: "warn", Fased reports potential evictions but does not mutate the store/files.
Run maintenance on demand:
Task/cron sessions and run logs
Scheduled task runs and legacy cron runs can create isolated session entries and transcripts. They have dedicated retention controls:cron.sessionRetention(default24h) prunes old isolated task/cron run sessions from the session store (falsedisables).cron.runLog.maxBytes+cron.runLog.keepLinesprune~/.fased/cron/runs/<jobId>.jsonlfiles. Defaults are2_000_000bytes and2000lines.
Session keys (sessionKey)
A sessionKey identifies which conversation bucket you’re in (routing + isolation).
Common patterns:
- Main/direct chat (per agent):
agent:<agentId>:<mainKey>(defaultmain) - Group:
agent:<agentId>:<channel>:group:<id> - Room/channel (Discord/Slack):
agent:<agentId>:<channel>:channel:<id>or...:room:<id> - Task/cron:
cron:<job.id> - Webhook:
hook:<uuid>(unless overridden)
Session ids (sessionId)
Each sessionKey points at a current sessionId (the transcript file that continues the conversation).
Rules of thumb:
- Reset (
/new,/reset) creates a newsessionIdfor thatsessionKey. - Daily reset defaults to 4:00 AM local time on the gateway host. It
creates a new
sessionIdon the next message after the reset boundary. - Idle expiry uses
session.reset.idleMinutesor legacysession.idleMinutes. It creates a newsessionIdwhen a message arrives after the idle window. When daily + idle are both configured, whichever expires first wins. - Thread parent fork guard uses
session.parentForkMaxTokenswith default100000. It skips parent transcript forking when the parent session is already too large, so the new thread starts fresh. Set0to disable.
initSessionState() in src/auto-reply/reply/session.ts.
Session store schema (sessions.json)
The store’s value type is SessionEntry in src/config/sessions.ts.
Key fields (not exhaustive):
sessionId: current transcript id (filename is derived from this unlesssessionFileis set)updatedAt: last activity timestampsessionFile: optional explicit transcript path overridechatType:direct | group | room(helps UIs and send policy)provider,subject,room,space,displayName: metadata for group/channel labeling- Toggles:
thinkingLevel,verboseLevel,reasoningLevel,elevatedLevelsendPolicy(per-session override)
- Model selection:
providerOverride,modelOverride,authProfileOverride
- Token counters (best-effort / provider-dependent):
inputTokens,outputTokens,totalTokens,contextTokens
compactionCount: how often auto-compaction completed for this session keymemoryFlushAt: timestamp for the last pre-compaction memory flushmemoryFlushCompactionCount: compaction count when the last flush ran
Transcript structure (*.jsonl)
Transcripts are managed by @mariozechner/pi-coding-agent’s SessionManager.
The file is JSONL:
- First line: session header (
type: "session", includesid,cwd,timestamp, optionalparentSession) - Then: session entries with
id+parentId(tree)
message: user/assistant/toolResult messagescustom_message: extension-injected messages that do enter model context (can be hidden from UI)custom: extension state that does not enter model contextcompaction: persisted compaction summary withfirstKeptEntryIdandtokensBeforebranch_summary: persisted summary when navigating a tree branch
SessionManager to read/write them.
Context windows vs tracked tokens
Two different concepts matter:- Model context window: hard cap per model (tokens visible to the model)
- Session store counters: rolling stats written into
sessions.json. These power chat status, Agent > Sessions, and fallback usage display.
- The context window comes from the model catalog (and can be overridden via config).
contextTokensin the store is a runtime estimate/reporting value; don’t treat it as an exact limit.
Compaction: what it is
Compaction summarizes older conversation into a persistedcompaction entry in the transcript and keeps recent messages intact.
After compaction, future turns see:
- The compaction summary
- Messages after
firstKeptEntryId
When auto-compaction happens (Pi runtime)
In the embedded Pi agent, auto-compaction triggers in two cases:- Overflow recovery: the model returns a context overflow error → compact → retry.
- Threshold maintenance: after a successful turn, when:
contextTokens > contextWindow - reserveTokens
Where:
contextWindowis the model’s context windowreserveTokensis headroom reserved for prompts + the next model output
Compaction settings (reserveTokens, keepRecentTokens)
Pi’s compaction settings live in Pi settings:
- If
compaction.reserveTokens < reserveTokensFloor, Fased bumps it. - Default floor is
20000tokens. - Set
agents.defaults.compaction.reserveTokensFloor: 0to disable the floor. - If it’s already higher, Fased leaves it alone.
ensurePiCompactionReserveTokens() in src/agents/pi-settings.ts
(called from src/agents/pi-embedded-runner.ts).
User-visible surfaces
You can observe compaction and session state via:- Chat
/status(current session) - Agent > Sessions (session list, last activity, transcript metadata, and protected delete actions)
- Usage page (token usage history; session counters are only a fallback when no better usage record exists)
fased status(CLI)fased sessions/sessions --json- Verbose mode:
🧹 Auto-compaction complete+ compaction count
Silent housekeeping (NO_REPLY)
Fased supports “silent” turns for background tasks where the user should not see intermediate output.
Convention:
- The assistant starts its output with
NO_REPLYto indicate “do not deliver a reply to the user”. - Fased strips/suppresses this in the delivery layer.
2026.1.10, Fased also suppresses draft/typing streaming when a
partial chunk begins with NO_REPLY. This keeps silent operations from showing
partial output mid-turn.
Pre-compaction “memory flush” (implemented)
Goal: before auto-compaction happens, run a silent agentic turn that writes durable state to disk (e.g.memory/YYYY-MM-DD.md in the agent workspace) so compaction can’t
erase critical context.
Fased uses the pre-threshold flush approach:
- Monitor session context usage.
- When it crosses a “soft threshold” (below Pi’s compaction threshold), run a silent “write memory now” directive to the agent.
- Use
NO_REPLYso the user sees nothing.
agents.defaults.compaction.memoryFlush):
enabled(default:true)softThresholdTokens(default:4000)prompt(user message for the flush turn)systemPrompt(extra system prompt appended for the flush turn)
- The default prompt/system prompt include a
NO_REPLYhint to suppress delivery. - The flush runs once per compaction cycle (tracked in
sessions.json). - The flush runs only for embedded Pi sessions (CLI backends skip it).
- The flush is skipped when the session workspace is read-only (
workspaceAccess: "ro"or"none"). - See Memory for the workspace file layout and write patterns.
session_before_compact hook in the extension API, but Fased’s
flush logic lives on the Gateway side today.
Troubleshooting checklist
- Session key wrong? Start with /concepts/session and
confirm the
sessionKeyin chat/statusor Agent > Sessions. - Store vs transcript mismatch? Confirm the Gateway host and the store path from
fased status. - Compaction spam? Check:
- model context window (too small)
- compaction settings (
reserveTokenstoo high for the model window can cause earlier compaction) - tool-result bloat: enable/tune session pruning
- Silent turns leaking? Confirm the reply starts with
NO_REPLYexactly, and confirm the build includes the streaming suppression fix.