Commit graph

894 commits

Author SHA1 Message Date
Krish Dholakia
11838e1c3b
Litellm fix db testing (#9593)
* ci: fix test

* test: safely change db url

* fix: print db url

* test: remove delenv
2025-03-27 14:50:41 -07:00
Krrish Dholakia
fb9abd40f3 ci(config.yml): add pytest-postgres to ci/cd 2025-03-26 16:25:08 -07:00
Krish Dholakia
801ecb6517
Nova Canvas complete image generation tasks (#9177) (#9525)
* Nova Canvas complete image generation tasks (#9177)

* add initial support for Amazon Nova Canvas model

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* adjust name to AmazonNovaCanvas and map function variables to config

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* tighten model name check

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* fix quality mapping

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add premium quality in config

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* support all Amazon Nova Canvas tasks

* remove unused import

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add tests for image generation tasks and fix payload

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add missing util file

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* update model prices backup file

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* remove image tasks other than text->image

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add color guided generation task for Nova Canvas

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* fix merge

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add nova canvas image generation documentation

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add nova canvas unit tests

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

---------

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* ci(config.yml): bump ci config

* test: fix test

---------

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
Co-authored-by: omrishiv <327609+omrishiv@users.noreply.github.com>
2025-03-26 11:28:20 -07:00
Ishaan Jaff
5f51228b72 DNS lookup for Redis host 2025-03-26 09:28:59 -07:00
Ishaan Jaff
d7884114d0 setup_google_dns 2025-03-26 09:26:33 -07:00
Ishaan Jaff
68665ea028 DNS lookup for Redis host 2025-03-26 09:25:14 -07:00
Ishaan Jaff
c3dc4a2ecd fix DNS resolution 2025-03-26 08:55:18 -07:00
Ishaan Jaff
e5a5dca777 fix load_testing 2025-03-26 08:46:23 -07:00
Ishaan Jaff
7123b69cca fix caching unit tests 2025-03-26 08:42:55 -07:00
Ishaan Jaff
c473e2b1c2 setup_google_dns 2025-03-25 23:02:02 -07:00
Ishaan Jaff
3725ba4f63 setup_google_dns 2025-03-25 22:52:31 -07:00
Ishaan Jaff
61816dfd04 litellm_assistants_api_testing bump python 2025-03-25 22:31:16 -07:00
Ishaan Jaff
24a329ea5b Set DNS 2025-03-25 22:29:40 -07:00
Ishaan Jaff
f1a8b1984a fix mcp test deps 2025-03-24 21:34:18 -07:00
Ishaan Jaff
f2b9a7f2ea pip install "langchain_mcp_adapters==0.0.5" 2025-03-24 21:20:11 -07:00
Ishaan Jaff
dcc2edbd4d fix mcp import 2025-03-24 21:02:54 -07:00
Ishaan Jaff
4a675da0f9 fix setup 2025-03-24 19:10:59 -07:00
Ishaan Jaff
08a4ba1b7e Merge branch 'main' into litellm_exp_mcp_server 2025-03-24 19:03:56 -07:00
Ishaan Jaff
395e4e73d0 langchain_mcp_adapters 2025-03-24 18:59:32 -07:00
Ishaan Jaff
ab1f87bb59 add "mcp==1.5.0" to optional pyproject for litellm proxy 2025-03-24 18:56:32 -07:00
Ishaan Jaff
ffce25cd94 bump deps 2025-03-24 18:44:24 -07:00
Ishaan Jaff
6e3f86f12f fix using mcp router 2025-03-24 18:36:42 -07:00
Krrish Dholakia
34166eb65c ci: update with clean db
db had expired key
2025-03-24 17:12:18 -07:00
Ishaan Jaff
5411aed2a8 fix mcp version 2025-03-24 16:57:47 -07:00
Ishaan Jaff
fe2e2cb357 Show current pydantic version 2025-03-24 16:46:53 -07:00
Ishaan Jaff
60242f9e48 fix py version 2025-03-24 16:45:43 -07:00
Ishaan Jaff
ff8a6d7cea litellm_utils_testing 2025-03-24 16:41:50 -07:00
Ishaan Jaff
0faf23c751 update to cimg/python:3.13.1 on ci/cd 2025-03-24 16:01:32 -07:00
Ishaan Jaff
ade2ea8f20 fix order of load tests on config.yml 2025-03-24 15:55:51 -07:00
Tyler Hutcherson
7864cd1f76 update redisvl dependency 2025-03-24 08:42:11 -04:00
Ishaan Jaff
3395004f0a bump pydantic 2025-03-22 19:00:25 -07:00
Ishaan Jaff
e85e3bc52a bump to pip install "openai==1.68.2" 2025-03-21 21:49:54 -07:00
Ishaan Jaff
0eb3ceff60 pip install "mcp==1.4.1" 2025-03-21 19:04:53 -07:00
Ishaan Jaff
ff2aed0e2f pip install "pydantic==2.7.2" 2025-03-21 19:03:31 -07:00
Ishaan Jaff
1faf82f768 test mcp on ci/cd 2025-03-21 17:51:37 -07:00
Ishaan Jaff
c58aff01e0 bump to openai==1.67.0 2025-03-20 09:26:05 -07:00
Krish Dholakia
d4caaae1be
Merge pull request #9274 from BerriAI/litellm_contributor_rebase_branch
Litellm contributor rebase branch
2025-03-14 21:57:49 -07:00
Krrish Dholakia
4bc5f27d7d fix(config.yml): fix ci/cd config.yml 2025-03-14 20:30:09 -07:00
Krrish Dholakia
0f6e0ac06d ci(config.yml): bump websocket version on ci/cd 2025-03-13 20:01:57 -07:00
Ishaan Jaff
08f4a6844b rename folder to test openai endpoints 2025-03-13 15:13:48 -07:00
Ishaan Jaff
036ac70b72 rename test config 2025-03-13 14:55:33 -07:00
Krrish Dholakia
ee6c9576d4 fix: bump websockets version on ci/cd 2025-03-13 14:38:22 -07:00
Ishaan Jaff
aa72f95a06 "openai==1.66.1" in testing 2025-03-12 13:00:59 -07:00
Ishaan Jaff
6702e492f5 pip install openai==1.66.1 2025-03-12 11:56:34 -07:00
Ishaan Jaff
9ea0c89a2d bump to openai==1.66.1 2025-03-12 11:52:03 -07:00
Ishaan Jaff
595af6898f llm_responses_api_testing 2025-03-12 11:51:22 -07:00
Ishaan Jaff
1b50e6d65f openai 1.66.1 2025-03-12 11:44:16 -07:00
Ishaan Jaff
8e30f1fb2f new test for llm_responses_api_coverage 2025-03-11 13:49:43 -07:00
Ishaan Jaff
f47987e673
(Refactor) /v1/messages to follow simpler logic for Anthropic API spec (#9013)
* anthropic_messages_handler v0

* fix /messages

* working messages with router methods

* test_anthropic_messages_handler_litellm_router_non_streaming

* test_anthropic_messages_litellm_router_non_streaming_with_logging

* AnthropicMessagesConfig

* _handle_anthropic_messages_response_logging

* working with /v1/messages endpoint

* working /v1/messages endpoint

* refactor to use router factory function

* use aanthropic_messages

* use BaseConfig for Anthropic /v1/messages

* track api key, team on /v1/messages endpoint

* fix get_logging_payload

* BaseAnthropicMessagesTest

* align test config

* test_anthropic_messages_with_thinking

* test_anthropic_streaming_with_thinking

* fix - display anthropic url for debugging

* test_bad_request_error_handling

* test_anthropic_messages_router_streaming_with_bad_request

* fix ProxyException

* test_bad_request_error_handling_streaming

* use provider_specific_header

* test_anthropic_messages_with_extra_headers

* test_anthropic_messages_to_wildcard_model

* fix gcs pub sub test

* standard_logging_payload

* fix unit testing for anthopic /v1/messages support

* fix pass through anthropic messages api

* delete dead code

* fix anthropic pass through response

* revert change to spend tracking utils

* fix get_litellm_metadata_from_kwargs

* fix spend logs payload json

* proxy_pass_through_endpoint_tests

* TestAnthropicPassthroughBasic

* fix pass through tests

* test_async_vertex_proxy_route_api_key_auth

* _handle_anthropic_messages_response_logging

* vertex_credentials

* test_set_default_vertex_config

* test_anthropic_messages_litellm_router_non_streaming_with_logging

* test_ageneric_api_call_with_fallbacks_basic

* test__aadapter_completion
2025-03-06 00:43:08 -08:00
Ishaan Jaff
f7bafbf2ab Install Node.js 2025-02-27 21:09:04 -08:00