Commit graph

18 commits

Author SHA1 Message Date
Matt Rubens
a64cab92dc
Fix openai cache tracking and cost estimates (#2616)
* fix(api): update cacheReadsPrice for OpenAI GPT-4.1 models (#2887)

Set correct cacheReadsPrice (cached input price) for gpt-4.1, gpt-4.1 mini, and gpt-4.1 nano based on official OpenAI pricing. No changes to cacheWritesPrice as per current OpenAI documentation. This ensures prompt caching costs are accurately reflected for these models in cost calculations.

* Update more OpenAI cache prices

* Track cache tokens and cost correctly for OpenAI

* Update tests

---------

Co-authored-by: monotykamary <tom81094@gmail.com>
2025-04-14 22:55:06 -04:00
Matt Rubens
8a1d66732a Infrastructure to support calling token count APIs, starting with Anthropic 2025-03-02 01:47:55 -05:00
Matt Rubens
5ffb145c13 Enable streaming for o1 2025-02-14 20:58:18 -05:00
Joe Manley
adedc1c2c6 Remove magic numbers 2025-02-07 23:08:26 -08:00
Roo Code
bc9773ff9a Configure per-configuration temperature 2025-02-08 00:21:13 -05:00
Roo Code
4b3ea07033 Prevent provider client instantiations from throwing 2025-02-07 03:06:01 -08:00
Nissa Seru
df932935cf Refactor openai-native, prepend string to developer instructions so that o1/o3 will use md 2025-02-01 22:53:54 -05:00
Matt Rubens
60a0a824b9 Prettier backfill 2025-01-17 14:11:28 -05:00
Matt Rubens
6e90bcf4a3 Update openai package and use developer role message for o1 2025-01-15 15:59:37 -05:00
Matt Rubens
4027e1c10c Add non-streaming completePrompt to all providers 2025-01-13 17:20:06 -05:00
Matt Rubens
0aa5f1fb85 Add the o1 model 2025-01-07 13:33:47 -05:00
Saoud Rizwan
9052528d2b Fix o1 in openai native 2024-10-18 07:56:15 -04:00
Saoud Rizwan
90b0c8243c Fixes 2024-10-16 18:00:53 -04:00
Saoud Rizwan
dff81b9d09 Fix o1 on openai native 2024-10-16 09:59:30 -04:00
Saoud Rizwan
7cb0c524e5 Add OpenRouter custom model scheme 2024-10-09 01:49:57 -04:00
Saoud Rizwan
06ccaf6f67 Implement streaming for all providers 2024-10-09 01:49:55 -04:00
Saoud Rizwan
05389b7dd5 Fix imports 2024-09-24 12:05:54 -04:00
Saoud Rizwan
a009c84597 Refactor API 2024-09-24 10:43:31 -04:00
Renamed from src/api/openai-native.ts (Browse further)