Commit graph

13341 commits

Author SHA1 Message Date
Ishaan Jaff
51b78422df fix http_request 2024-06-11 17:57:50 -07:00
Krrish Dholakia
a9cbf2209c fix(utils.py): support dynamic api key for azure_ai route 2024-06-11 17:51:29 -07:00
Ishaan Jaff
479a39cebd fix test new team 2024-06-11 17:48:11 -07:00
Krrish Dholakia
a1ca70a8a7 fix: more bug fixes 2024-06-11 17:41:59 -07:00
hughcrt
418caf800d fix: lunary callback tags 2024-06-11 21:30:11 -03:00
Krrish Dholakia
6305d2dbcf fix(__init__.py): add 'log_raw_request_response' flag to init 2024-06-11 17:26:03 -07:00
Ishaan Jaff
30f74aa471 fix import error 2024-06-11 17:17:57 -07:00
Ishaan Jaff
427f2ee1fa feat - otel log /team exceptions 2024-06-11 16:27:07 -07:00
Ishaan Jaff
f2abac748e fix refactor management endpoint utils 2024-06-11 16:16:10 -07:00
Krrish Dholakia
c27ae34a39 fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
standardizes error code for budget exceeded errors to status code 400
2024-06-11 16:10:58 -07:00
Ishaan Jaff
13cb49688a feat - log management endpoint logs to otel 2024-06-11 16:09:11 -07:00
Krrish Dholakia
9c7788ae48 fix(utils.py): fix formatting 2024-06-11 15:49:20 -07:00
Krrish Dholakia
2d8e4ddfa0 fix(main.py): trigger new build 2024-06-11 15:13:50 -07:00
James Braza
917e8678db Added mypy to the dev Poetry group 2024-06-11 14:43:32 -07:00
Ishaan Jaff
5eb2822d31
Merge pull request #4133 from BerriAI/litellm_work_with_traceparents
[Feat] OTEL - allow propagating traceparent in headers
2024-06-11 14:27:08 -07:00
Ishaan Jaff
d7f1445615 doc - OTEL trace propogation 2024-06-11 14:25:33 -07:00
Krrish Dholakia
61a450d0fc docs(azure_ai.md): add updated azure ai routing docs 2024-06-11 14:18:34 -07:00
Krrish Dholakia
f40d47942f test(test_completion.py): add testing to make sure tool calling works as expected for 'azure_ai/' route 2024-06-11 14:11:02 -07:00
Krrish Dholakia
88e567af2c fix(utils.py): add new 'azure_ai/' route
supports azure's openai compatible api endpoint
2024-06-11 14:06:56 -07:00
Ishaan Jaff
d829e6a297 test - propogate trace IDs across services 2024-06-11 14:00:25 -07:00
Ishaan Jaff
7ce1289548 feat - use traceparent to proporgate OTEL traces 2024-06-11 13:57:31 -07:00
dependabot[bot]
1a847ec47c
build(deps): bump braces from 3.0.2 to 3.0.3 in /ui/litellm-dashboard
Bumps [braces](https://github.com/micromatch/braces) from 3.0.2 to 3.0.3.
- [Changelog](https://github.com/micromatch/braces/blob/master/CHANGELOG.md)
- [Commits](https://github.com/micromatch/braces/compare/3.0.2...3.0.3)

---
updated-dependencies:
- dependency-name: braces
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-11 20:37:41 +00:00
Krrish Dholakia
a389ec95a2 bump: version 1.40.8 → 1.40.9 2024-06-11 13:36:40 -07:00
Krrish Dholakia
7eae0ff7e3 fix(utils.py): allow user to opt in to raw request logging to langfuse 2024-06-11 13:35:22 -07:00
dependabot[bot]
8838c8af66
build(deps): bump azure-identity from 1.15.0 to 1.16.1
Bumps [azure-identity](https://github.com/Azure/azure-sdk-for-python) from 1.15.0 to 1.16.1.
- [Release notes](https://github.com/Azure/azure-sdk-for-python/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-python/blob/main/doc/esrp_release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-python/compare/azure-identity_1.15.0...azure-identity_1.16.1)

---
updated-dependencies:
- dependency-name: azure-identity
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-11 20:32:08 +00:00
Krrish Dholakia
a8ea7c6d31 docs(ui.md): add okta sso support to docs 2024-06-11 13:17:41 -07:00
Krrish Dholakia
c9bb4b29c7 docs(vertex.md): add vertex ai function calling to docs 2024-06-11 12:32:24 -07:00
Ishaan Jaff
7b4fca8fb7
Merge pull request #4129 from BerriAI/litellm_fix_docker
fix opentelemetry-semantic-conventions-ai does not exist on LiteLLM Docker
2024-06-11 12:30:46 -07:00
Ishaan Jaff
1af3d34d8b fix OTEL semantic conventions does not exist 2024-06-11 12:28:38 -07:00
Ishaan Jaff
842b8337e6 fix opentelemetry-semantic-conventions-ai 2024-06-11 12:19:56 -07:00
David Manouchehri
844f15f8b0
fix(bedrock_httpx.py): Add IAM caching for converse flow. 2024-06-11 17:00:18 +00:00
David Manouchehri
9aee0b4a0f
fix(bedrock_httpx.py): Fix STS region endpoint for converse flow. 2024-06-11 16:35:03 +00:00
David Manouchehri
d950373768
feat(azure.py): Add Azure AD cred caching for OIDC flow. 2024-06-11 15:54:44 +00:00
David Manouchehri
a31fa5fbc8
feat(util.py/azure.py): Add OIDC support when running in Azure Kubernetes Service (AKS). 2024-06-11 15:54:34 +00:00
David Manouchehri
857df1d6af
Merge remote-tracking branch 'upstream/main' into aks-oidc-1852 2024-06-11 15:54:10 +00:00
David Manouchehri
95a4bc46d4
Revert "feat(util.py/azure.py): Add OIDC support when running in Azure Kubernetes Service (AKS)."
This reverts commit 640b955e12.
2024-06-11 15:52:07 +00:00
David Manouchehri
7154c25903
Revert "feat(azure.py): Add Azure AD cred caching for OIDC flow."
This reverts commit 73d9d0d7db.
2024-06-11 15:51:59 +00:00
David Manouchehri
7faf0b9586
fix(bedrock_httpx.py): Fix STS region endpoint. 2024-06-11 15:43:33 +00:00
David Manouchehri
cd21c80a15
feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow. 2024-06-11 15:43:15 +00:00
David Manouchehri
02aaaf5976
Merge remote-tracking branch 'upstream/main' into oidc-bedrock-httpx-caching-part-1 2024-06-11 15:42:31 +00:00
David Manouchehri
4de9e46d42
Revert "feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow."
This reverts commit 240a0da271.
2024-06-11 15:42:18 +00:00
David Manouchehri
1a77c1bf16
Revert "fix(bedrock_httpx.py): Fix STS region endpoint."
This reverts commit fd16937ad8.
2024-06-11 15:42:09 +00:00
Krrish Dholakia
318abde095 docs(users.md): fix typo 2024-06-10 22:37:30 -07:00
Krrish Dholakia
5c423caffd docs(users.md): fix typo 2024-06-10 22:36:46 -07:00
Krrish Dholakia
61834eed7b docs(users.md): add team reset budgets to docs 2024-06-10 22:29:55 -07:00
Ishaan Jaff
b875a72be8 docs - reliability 2024-06-10 21:54:38 -07:00
Ishaan Jaff
d628bf0bd3 fix azure falbacks test 2024-06-10 21:50:54 -07:00
Krrish Dholakia
2e49614230 fix(utils.py): exception map vertex ai 500 internal server errors 2024-06-10 21:37:54 -07:00
Krrish Dholakia
b756374a4f feat(utils.py): bump tiktoken dependency to 0.7.0
adds support for gpt-4o token counting
2024-06-10 21:21:23 -07:00
Ishaan Jaff
a7e9e5b3cb ui - new build 2024-06-10 21:11:33 -07:00