20943 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Ishaan Jaff	f5ef0c3cb7	fix code quality checks	2025-03-18 22:34:43 -07:00
Krrish Dholakia	3033c40739	fix(base_routing_strategy.py): fix base to handle no running event loop ... run in a separate thread	2025-03-18 22:20:39 -07:00
Ishaan Jaff	0f2e095b6b	_arize_otel_logger	2025-03-18 22:19:51 -07:00
Ishaan Jaff	57e5c94360	Merge branch 'main' into litellm_arize_dynamic_logging	2025-03-18 22:13:35 -07:00
Ishaan Jaff	c101fe9b5d	Merge pull request #9352 from BerriAI/litellm_arize_mar_18 ... [Bug Fix] Arize AI Logging Integration with LiteLLM	2025-03-18 22:12:46 -07:00
Ishaan Jaff	412ad0d64e	test_arize_callback	2025-03-18 20:21:23 -07:00
Krrish Dholakia	a3d000baaa	fix(test_base_routing_strategy.py): add unit testing for new base routing strategy test	2025-03-18 19:59:06 -07:00
Krrish Dholakia	ef008138a3	feat(base_routing_strategy.py): handle updating in-memory keys	2025-03-18 19:44:04 -07:00
Krrish Dholakia	1328afe612	fix(lowest_tpm_rpm_v2.py): support batch writing increments to redis	2025-03-18 19:09:53 -07:00
Ishaan Jaff	19a7bfa6b5	test_arize_callback	2025-03-18 18:49:06 -07:00
Ishaan Jaff	00795f2bbf	test arize logging	2025-03-18 18:40:39 -07:00
Ishaan Jaff	65083ca8da	get_openai_client_cache_key	2025-03-18 18:35:50 -07:00
Krish Dholakia	24fbadf072	Merge pull request #9355 from BerriAI/litellm_dev_03_18_2025_p1 ... Litellm dev 03 18 2025 p1	2025-03-18 18:34:06 -07:00
Ishaan Jaff	40418c7bd8	test_openai_client_reuse	2025-03-18 18:13:36 -07:00
Ishaan Jaff	d5150e000d	test openai common utils	2025-03-18 18:08:24 -07:00
Ishaan Jaff	3daef0d740	fix common utils	2025-03-18 17:59:46 -07:00
Ishaan Jaff	a45830dac3	use common caching logic for openai/azure clients	2025-03-18 17:57:03 -07:00
Ishaan Jaff	f73e9047dc	use common logic for re-using openai clients	2025-03-18 17:56:32 -07:00
Krrish Dholakia	a34cc2031d	fix(response_metadata.py): log the litellm_model_name ... make it easier to track the model sent to the provider	2025-03-18 17:46:33 -07:00
Krrish Dholakia	8ed3483adb	test(test_tpm_rpm_routing_v2.py): initial test, for asserting async pre call check works as expected	2025-03-18 17:36:55 -07:00
Ishaan Jaff	bdf77f6f4b	fix ensure async client test	2025-03-18 17:29:10 -07:00
Ishaan Jaff	c010cdef59	test_dynamic_azure_params	2025-03-18 17:26:23 -07:00
Krrish Dholakia	453729b6c9	fix(litellm_logging.py): fix update	2025-03-18 17:18:58 -07:00
Krrish Dholakia	39ac9e3eca	fix(lowest_tpm_rpm_v2.py): fix updating limits	2025-03-18 17:10:17 -07:00
Ishaan Jaff	78a5dde31f	fix code qa	2025-03-18 17:07:44 -07:00
Ishaan Jaff	bd122f631e	fix arize config	2025-03-18 16:54:31 -07:00
Krrish Dholakia	cfe94c86cc	fix(lowest_tpm_rpm_routing_v2.py): fix deployment update to use correct keys	2025-03-18 16:28:37 -07:00
Krrish Dholakia	9bf6028f14	fix(lowest_tpm_rpm_v2.py): update key to use model name	2025-03-18 16:19:47 -07:00
Ishaan Jaff	de97cda445	refactor create_litellm_proxy_request_started_spen	2025-03-18 16:12:16 -07:00
Ishaan Jaff	f4b7b49e9a	fix arize logging	2025-03-18 15:51:58 -07:00
Ishaan Jaff	7a5726fc88	fix - Arize - only log LLM I/O	2025-03-18 15:50:38 -07:00
Ishaan Jaff	41d9cc14be	test_async_dynamic_arize_config	2025-03-18 15:02:22 -07:00
Ishaan Jaff	f8c49175ec	fix _get_span_processor	2025-03-18 14:59:13 -07:00
Ishaan Jaff	b940c969fd	use _get_headers_dictionary	2025-03-18 14:55:39 -07:00
Ishaan Jaff	57d08531a1	add arize_api_key to StandardCallbackDynamicParams	2025-03-18 14:46:55 -07:00
Ishaan Jaff	3e0df0fc1e	test_arize_set_attributes	2025-03-18 14:31:34 -07:00
Ishaan Jaff	48663a0920	use safe dumps for arize ai	2025-03-18 14:30:00 -07:00
Ishaan Jaff	959299c8ea	Merge pull request #9338 from nate-mar/arize-integration-fixes ... Arize integration Fix	2025-03-18 14:28:25 -07:00
Ishaan Jaff	55ea2370ba	Union[TranscriptionResponse, Coroutine[Any, Any, TranscriptionResponse]]:	2025-03-18 14:23:14 -07:00
Ishaan Jaff	7384d45ef0	fix type errors on transcription azure	2025-03-18 14:22:30 -07:00
Ishaan Jaff	b20a69f9fc	fix code quality	2025-03-18 12:58:59 -07:00
Emerson Gomes	1cc832f53e	Fix TTFT prioritization for streaming in LowestLatencyLoggingHandler	2025-03-18 14:58:55 -05:00
Ishaan Jaff	dc3d7b3afc	test_azure_instruct	2025-03-18 12:56:11 -07:00
Ishaan Jaff	2cd49ef096	fix test_ensure_initialize_azure_sdk_client_always_used	2025-03-18 12:46:55 -07:00
Ishaan Jaff	b60178f534	fix azure chat logic	2025-03-18 12:42:24 -07:00
Ishaan Jaff	80a5cfa01d	test_azure_embedding_max_retries_0	2025-03-18 12:35:34 -07:00
Ishaan Jaff	b316911120	fix typing errors	2025-03-18 12:31:44 -07:00
Ishaan Jaff	6987a73e36	initialize_azure_sdk_client	2025-03-18 12:27:17 -07:00
Ishaan Jaff	842625a6f0	:test_completion_azure_ad_toke	2025-03-18 12:25:32 -07:00
Krrish Dholakia	00b338cb9c	test: refactor testing to handle routing correctly	2025-03-18 12:24:12 -07:00