fix(insights): show cache tokens in /insights token breakdown#18632
Open
liuhao1024 wants to merge 1 commit into
Open
fix(insights): show cache tokens in /insights token breakdown#18632liuhao1024 wants to merge 1 commit into
liuhao1024 wants to merge 1 commit into
Conversation
The /insights report total_tokens includes cache_read_tokens + cache_write_tokens, but the (in: / out: ) breakdown only showed input and output tokens. For Anthropic users with prompt caching, the cache tokens dominate the total, making the in/out numbers appear wrong or swapped. - Terminal format: add a 'Cache tokens' line when cache > 0 - Gateway format: append '/ cache: N' to the token breakdown - Both formats hide cache when all values are 0 (no noise) - Add 5 regression tests for cache display behavior Closes NousResearch#18615
alt-glitch
added
type/bug
Cyrene963
pushed a commit
to Cyrene963/hermes-agent
that referenced
this pull request
May 3, 2026
Community PRs applied: - NousResearch#18596: Enable secret redaction by default (SECURITY) - NousResearch#18650: Sanitize malformed tool messages + auto-recover on API 400 - NousResearch#18607: Emergency compression before max_iterations exhaustion - NousResearch#18603: Compression fallback to main model on 413 rate limit - NousResearch#18638: Pass threshold_percent on model switch - NousResearch#18663: Strip extra_content from tool_calls for strict APIs - NousResearch#18618: Forward explicit_api_key to OpenRouter - NousResearch#18632: Show cache tokens in /insights breakdown - NousResearch#18614: Add idempotency guard for patch duplicate loops - NousResearch#18600: Raise ValueError when HERMES_HOME unset in profile mode - NousResearch#18616: Allow ZWJ emoji in context files - NousResearch#18582: Reload .env on /restart - NousResearch#18547: Stabilize system prompt prefix for KV cache reuse - NousResearch#18692: Strip FTS5 operators from session search truncation terms Fix: Add order_by_last_active=True to list_sessions_rich call (pre-existing commit 142b4bf code sync)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The
/insightsreport'stotal_tokensincludescache_read_tokens + cache_write_tokens, but the(in: / out: )breakdown only showed input and output tokens. For Anthropic users with prompt caching enabled, cache tokens can dominate the total (e.g., 5.2M total but only 2.6K input / 88K output), making the in/out numbers appear swapped or wrong.Root Cause
In
agent/insights.py, the_compute_overview()method correctly sums all four token categories intototal_tokens:But both display methods (
format_terminalandformat_gateway) only showed input and output:Fix
Cache tokensline (with read/write breakdown) that appears only when cache tokens are non-zero/ cache: Nto the existing(in: / out: )breakdown when cache tokens existAfter fix
Test Plan
pytest tests/agent/test_insights.py)Closes #18615