scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-13 23:11:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 101
29986 commits 2338 branches 1407 tags 2.6 GiB
Commit graph

2 commits

Author SHA1 Message Date
Sameer Kankute
777ae4f530 Fix :test_count_tokens_caching 2026-01-10 00:57:11 +05:30
Constantine
3ebec39b74
fix(proxy): use async anthropic client to prevent event loop blocking (#18435) 
Fixes #16716.
Previously, synchronous Anthropic client was used for token counting, which blocked the event loop.
This change switches to AsyncAnthropic and caches the client instance.
 2026-01-08 23:26:46 +05:30