Ishaan Jaff
ff33ed020c
fix auth checks
2025-03-26 15:45:58 -07:00
Ishaan Jaff
8bd2081dec
fix get_key_object
2025-03-26 15:41:40 -07:00
Ishaan Jaff
f8caebc54b
is_database_connection_error
2025-03-26 14:55:40 -07:00
Ishaan Jaff
4948673e35
fix test changes
2025-03-26 14:51:33 -07:00
Ishaan Jaff
1812ce4a54
undo config.yml changes
2025-03-26 14:43:03 -07:00
Ishaan Jaff
044c56c439
Merge branch 'main' into litellm_stability_fixes
2025-03-26 14:41:43 -07:00
Krish Dholakia
801ecb6517
Nova Canvas complete image generation tasks ( #9177 ) ( #9525 )
...
* Nova Canvas complete image generation tasks (#9177 )
* add initial support for Amazon Nova Canvas model
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* adjust name to AmazonNovaCanvas and map function variables to config
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* tighten model name check
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* fix quality mapping
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* add premium quality in config
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* support all Amazon Nova Canvas tasks
* remove unused import
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* add tests for image generation tasks and fix payload
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* add missing util file
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* update model prices backup file
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* remove image tasks other than text->image
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* add color guided generation task for Nova Canvas
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* fix merge
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* add nova canvas image generation documentation
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
* add nova canvas unit tests
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
---------
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
* ci(config.yml): bump ci config
* test: fix test
---------
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
Co-authored-by: omrishiv <327609+omrishiv@users.noreply.github.com>
2025-03-26 11:28:20 -07:00
Ishaan Jaff
8c845847cd
fix vertex embedding perf test
2025-03-26 10:25:50 -07:00
Ishaan Jaff
5f51228b72
DNS lookup for Redis host
2025-03-26 09:28:59 -07:00
Ishaan Jaff
d7884114d0
setup_google_dns
2025-03-26 09:26:33 -07:00
Ishaan Jaff
68665ea028
DNS lookup for Redis host
2025-03-26 09:25:14 -07:00
Krrish Dholakia
a97d0563b4
build(model_prices_and_context_window.json): add commercial rate limits for gemini 2.0 flash lite
2025-03-26 08:58:35 -07:00
Ishaan Jaff
c3dc4a2ecd
fix DNS resolution
2025-03-26 08:55:18 -07:00
Ishaan Jaff
e5a5dca777
fix load_testing
2025-03-26 08:46:23 -07:00
Ishaan Jaff
7123b69cca
fix caching unit tests
2025-03-26 08:42:55 -07:00
Ishaan Jaff
22dfc4dea9
fix user_api_key_auth example config
2025-03-26 08:36:11 -07:00
Ishaan Jaff
e7a8b5a809
run ci/cd again
2025-03-26 08:12:51 -07:00
Ishaan Jaff
fafbaf6302
Merge branch 'main' into litellm_stability_fixes
2025-03-26 07:16:31 -07:00
Krish Dholakia
6fd18651d1
Support litellm.api_base for vertex_ai + gemini/ across completion, embedding, image_generation ( #9516 )
...
* test(tests): add unit testing for litellm_proxy integration
* fix(cost_calculator.py): fix tracking cost in sdk when calling proxy
* fix(main.py): respect litellm.api_base on `vertex_ai/` and `gemini/` routes
* fix(main.py): consistently support custom api base across gemini + vertexai on embedding + completion
* feat(vertex_ai/): test
* fix: fix linting error
* test: set api base as None before starting loadtest
2025-03-25 23:46:20 -07:00
Ishaan Jaff
8657816477
fix gemini/gemini-2.0-flash-lite on model cost map
2025-03-25 23:20:43 -07:00
Ishaan Jaff
6e5d2b1ac7
handle failed db connections
2025-03-25 23:14:44 -07:00
Krrish Dholakia
e0880734d9
docs(config_settings.md): cleanup docs
2025-03-25 23:11:45 -07:00
Krrish Dholakia
24b3e80eba
ci: update github action
2025-03-25 23:11:45 -07:00
Ishaan Jaff
c61214dcf1
Merge pull request #9523 from BerriAI/litellm_add_gemini_flash_lite
...
[Feat - New Model] Add VertexAI `gemini-2.0-flash-lite` and Google AI Studio `gemini-2.0-flash-lite`
2025-03-25 23:11:44 -07:00
Ishaan Jaff
c473e2b1c2
setup_google_dns
2025-03-25 23:02:02 -07:00
Ishaan Jaff
3725ba4f63
setup_google_dns
2025-03-25 22:52:31 -07:00
Ishaan Jaff
61816dfd04
litellm_assistants_api_testing bump python
2025-03-25 22:31:16 -07:00
Ishaan Jaff
24a329ea5b
Set DNS
2025-03-25 22:29:40 -07:00
Ishaan Jaff
9aec7c3878
test_create_delete_assistants
2025-03-25 22:08:06 -07:00
Ishaan Jaff
79ef184345
run ci/cd again
2025-03-25 21:57:45 -07:00
Ishaan Jaff
0a401ee468
test_litellm_proxy_server_config_no_general_settings
2025-03-25 19:27:15 -07:00
Ishaan Jaff
6572ba7a0e
fix startup
2025-03-25 19:25:47 -07:00
Ishaan Jaff
b4e745323a
add test config
2025-03-25 19:21:51 -07:00
Ishaan Jaff
9d10befa09
test_litellm_proxy_server_config_no_general_settings
2025-03-25 19:16:34 -07:00
Ishaan Jaff
4386558582
litellm_proxy_reliability_tests
2025-03-25 19:11:13 -07:00
Ishaan Jaff
53d9e33e78
fix setup toxi proxy
2025-03-25 18:59:26 -07:00
Ishaan Jaff
9e2d230339
litellm_proxy_reliability_tests
2025-03-25 18:23:52 -07:00
Ishaan Jaff
6f138c79a7
run toxi proxy tests
2025-03-25 18:19:11 -07:00
Ishaan Jaff
83b41f95e7
Setup Toxiproxy
2025-03-25 18:05:41 -07:00
Ishaan Jaff
bf7241abd1
litellm_proxy_reliability_tests
2025-03-25 18:02:01 -07:00
Ishaan Jaff
53a586e876
TOXI_PROXY_DATABASE_URL
2025-03-25 17:59:38 -07:00
Krish Dholakia
6cd6ff801f
ci(publish-migrations.yml): add action for publishing prisma db migrations ( #9537 )
2025-03-25 17:55:59 -07:00
Ishaan Jaff
34c3825d13
fix path
2025-03-25 17:53:30 -07:00
Ishaan Jaff
7b09d88680
fix setup
2025-03-25 17:52:12 -07:00
Ishaan Jaff
c6d5793bf6
add toxi proxy tests to ci/cd
2025-03-25 17:50:27 -07:00
Ishaan Jaff
ce49e27217
fixes for auth checks
2025-03-25 15:44:13 -07:00
Ishaan Jaff
59040167ac
fix ProxyErrorTypes
2025-03-25 14:40:11 -07:00
Ishaan Jaff
4c87084ff7
UserAPIKeyAuthExceptionHandler
2025-03-25 14:07:14 -07:00
Krrish Dholakia
e8c4cd8c1a
docs: cleanup docs
2025-03-25 12:25:42 -07:00
Krrish Dholakia
1a58e8bfe5
docs(admin_ui_sso.md): add logout url
2025-03-25 12:25:16 -07:00
