Roo-Code/packages
Hannes Rudolph f9f01b012c
fix: resolve Claude Code token counting inefficiency and enable caching (#5104) (#5108)
* fix: resolve Claude Code token counting inefficiency and enable caching (#5104)

- Remove 1.5x fudge factor from Claude Code token counting
- Enable prompt caching support for all Claude Code models
- Add comprehensive tests for token counting and caching
- Update existing tests to reflect accurate token counting

This fixes the extreme token inefficiency where simple messages would
jump from ~40k to over 60k tokens, causing API hangs when approaching
the artificial 120k limit. Claude Code now properly utilizes its full
200k context window with accurate token counting.

* fix: address PR review comments

- Extract IMAGE_TOKEN_ESTIMATE as a named constant for clarity
- Update token counting tests to use exact counts instead of ranges for deterministic testing
- Fix test expectations to match actual tokenizer output

* Remove token counting changes, keep only cache support

- Removed custom countTokens override from claude-code.ts
- Deleted claude-code-token-counting.spec.ts test file
- Kept cache token collection and reporting functionality
- Kept supportsPromptCache: true for all Claude Code models
- Kept claude-code-caching.spec.ts tests

This focuses the PR on enabling cache support without modifying token counting behavior.

* fix: update webview test to expect supportsPromptCache=true for Claude Code models

---------

Co-authored-by: Daniel Riccio <ricciodaniel98@gmail.com>
2025-06-25 20:36:06 -04:00
..
build Sharing improvements (#5082) 2025-06-24 16:36:32 -04:00
cloud Sharing improvements (#5082) 2025-06-24 16:36:32 -04:00
config-eslint Upgrade to ESLint 9 + share eslint config across workspaces (#3815) 2025-05-21 21:30:21 -07:00
config-typescript Roo Code Cloud (#4069) 2025-05-28 20:43:30 -07:00
evals Update evals Docker setup to work on Windows. (#4656) 2025-06-17 11:23:43 -07:00
ipc Farewell jest (#4607) 2025-06-16 21:39:45 -07:00
telemetry Git repo cloud telemetry (#5119) 2025-06-25 17:01:32 -07:00
types fix: resolve Claude Code token counting inefficiency and enable caching (#5104) (#5108) 2025-06-25 20:36:06 -04:00