Roo-Code/packages
Roo Code 40ad09478b feat: implement token-based file reading to prevent context exhaustion
- Add maxReadFileTokens setting to global settings schema (default: 10000)
- Update extractTextFromFile to use token counting with tiktoken
- Modify UI components to show token-based settings instead of line-based
- Update all callers of extractTextFromFile to pass the new parameter
- Add comprehensive tests for token-based truncation
- Token-based truncation takes precedence over line-based when both are set

This addresses issue #6274 by preventing context window exhaustion when
reading files with very long lines that contain many tokens.
2025-07-27 15:54:19 +00:00
..
build Sharing improvements (#5082) 2025-06-24 16:36:32 -04:00
cloud Bugfix: Cloud: be more specific about session error codes (#6051) 2025-07-22 07:16:15 -07:00
config-eslint Upgrade to ESLint 9 + share eslint config across workspaces (#3815) 2025-05-21 21:30:21 -07:00
config-typescript Roo Code Cloud (#4069) 2025-05-28 20:43:30 -07:00
evals Use SIGKILL for command execution timeouts in the "execa" variant (#6071) 2025-07-23 01:47:10 -07:00
ipc Farewell jest (#4607) 2025-06-16 21:39:45 -07:00
telemetry Git repo cloud telemetry (#5119) 2025-06-25 17:01:32 -07:00
types feat: implement token-based file reading to prevent context exhaustion 2025-07-27 15:54:19 +00:00