Chris Estreich
cb29e9d56f
Remove ModelInfo objects from settings ( #2939 )
2025-04-25 15:23:25 -07:00
Chris Estreich
06db547308
Use a WASM-based tiktoken implementation ( #2859 )
...
* Use a WASM-based tiktoken implementation
* Clean up imports
2025-04-25 10:32:35 -07:00
Chris Estreich
3322e08cb7
Relax provider profiles schema and log parse error to PostHog ( #2139 )
...
* Relax provider profiles schema and log parse error to PostHog
* Create wise-moose-shop.md
---------
Co-authored-by: Matt Rubens <mrubens@users.noreply.github.com>
2025-03-30 23:07:34 -07:00
Matt Rubens
7e62d34570
PR cleanup
2025-03-02 02:12:21 -05:00
Matt Rubens
8a1d66732a
Infrastructure to support calling token count APIs, starting with Anthropic
2025-03-02 01:47:55 -05:00
Matt Rubens
a0684454a2
Add a dynamic token buffer
2025-03-01 10:10:24 -05:00
Matt Rubens
764d963c10
Add a 5k token buffer before the end of the context window
2025-03-01 08:49:10 -05:00
Chris Estreich
481d613bc8
Estimate the number of tokens in the last message for sliding window math
2025-02-28 21:34:53 -08:00
Chris Estreich
5e53d00ebc
Allow control over maxTokens for thinking models
2025-02-26 14:23:11 -08:00
Matt Rubens
8ec903dd8d
Fix typo
2025-02-25 17:58:04 -05:00
Matt Rubens
d8cafbc67e
Simplify the context truncation math
2025-02-25 15:29:56 -05:00
cte
6245aa7629
Add tests
2025-02-24 15:40:31 -08:00
cte
1d67f88aba
Sliding window fix
2025-02-24 15:09:46 -08:00
Nissa Seru
98c8cc9624
Updated sliding window logic to be inverse of trigger criteria
2025-02-05 04:53:21 -05:00
Nissa Seru
3492f79f37
Remove unnecessary variable, add JSDocs
2025-02-02 02:56:30 -05:00
Matt Rubens
fef95e10b8
Fix type
2025-02-02 01:34:45 -05:00
Matt Rubens
9da39e42e1
Fix conflict
2025-02-02 01:23:45 -05:00
Nissa Seru
d154d059a6
Enable separate config for truncation for models without context caching
2025-01-31 06:17:20 -05:00
Mark Percival
93e70c62f1
Chore: Prettier for consistant formatting ( #794 )
...
* Chore: Pretier for consistant formatting
- TODO: This PR needs to be updated by Saoud after he runs `npm install` & `npm format:fix` and commits the results of the prettier changes.
* Revert prettier config
* Run npm install
* Fix prettier config and ignore package lock
* Run format
---------
Co-authored-by: Saoud Rizwan <7799382+saoudrizwan@users.noreply.github.com>
2024-11-21 13:13:54 -08:00
Saoud Rizwan
40f7942801
Refactor out of utils
2024-09-24 11:45:12 -04:00