scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-06 02:48:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103
litellm/tests/test_litellm/rust_bridge
History
Exact
yassin 13036b72f8 feat(rust_bridge): count prompt, input, query and documents bodies in Rust 
The Rust token counter now mirrors _count_input_tokens key precedence
(messages, prompt, input, query/documents) so every LLM route that goes
through budget reservation gets the GIL-free count, not only /v1/messages
and /v1/chat/completions. Objects are serialised like json.dumps before
tokenizing; floats and unknown shapes still decline to Python. The body
model is optional so route-selected models can be matched by the caller

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-09 22:36:11 +00:00
..
native_route_wheel_test.py refactor(tests): restructure rust python harness around strategy definitions (#39628) 2026-09-03 21:15:01 -07:00
test_bindings.py Merge pull request #39334 from BerriAI/litellm_rust_opt_in_configuration 2026-09-02 16:26:36 -07:00
test_chat_completions.py refactor(rust): remove per-request enablement arguments (#39928) 2026-09-07 10:43:45 -07:00
test_configuration.py refactor(rust): remove per-request enablement arguments (#39928) 2026-09-07 10:43:45 -07:00
test_runtime.py Merge pull request #39334 from BerriAI/litellm_rust_opt_in_configuration 2026-09-02 16:26:36 -07:00
test_token_counter.py feat(rust_bridge): count prompt, input, query and documents bodies in Rust 2026-09-09 22:36:11 +00:00
test_verify_linux_native_wheel.py test(build): keep wheel checks outside package 2026-09-02 12:16:25 -07:00