Paul Gauthier
4a53754436
Added openrouter/anthropic/claude-3.5-sonnet to model json
2024-06-27 20:20:46 -07:00
Krrish Dholakia
f225174024
docs(function_call.md): cleanup
2024-06-27 20:20:46 -07:00
Ishaan Jaff
e1c54c4c2b
run again
2024-06-27 20:20:46 -07:00
Krrish Dholakia
5e96e035b2
docs(routing.md): add dynamic cooldowns to docs
2024-06-27 20:20:46 -07:00
Krrish Dholakia
b8316d8a8d
fix(router.py): set cooldown_time: per model
2024-06-27 20:20:46 -07:00
Krish Dholakia
b890229cff
Revert "Create litellm user to fix issue with prisma in k8s "
2024-06-27 20:20:46 -07:00
Ishaan Jaff
d8b548b1ce
bump: version 1.40.26 → 1.40.27
2024-06-27 20:20:46 -07:00
Steven Osborn
2b4628fc07
create litellm user to fix issue in k8s where prisma fails due to user nobody without home directory
2024-06-27 20:20:46 -07:00
Ishaan Jaff
882b6dcab4
fix only use crypto imports when needed
2024-06-27 20:20:46 -07:00
Ishaan Jaff
85f463dff5
fix - verify license without api request
2024-06-27 20:20:46 -07:00
Krrish Dholakia
aa9e542d21
fix(predibase.py): support json schema on predibase
2024-06-27 20:20:31 -07:00
Krrish Dholakia
adfb9cda79
fix(utils.py): predibase exception mapping - map 424 as a badrequest error
2024-06-27 20:20:31 -07:00
Ishaan Jaff
6e10a122b1
fix detect secrets test
2024-06-27 20:20:31 -07:00
Ishaan Jaff
13f4ecb7ec
docs - secret detection
2024-06-27 20:20:31 -07:00
Ishaan Jaff
1962a24802
test secret detection
2024-06-27 20:20:31 -07:00
Ishaan Jaff
92eed81077
clean up secret detection
2024-06-27 20:20:31 -07:00
Ishaan Jaff
8a7b16102c
fix async_pre_call_hook
2024-06-27 20:20:31 -07:00
Ishaan Jaff
350e87f1d6
init secret detection callback
2024-06-27 20:20:31 -07:00
Ishaan Jaff
d7643eb9f2
feat - add secret detection
2024-06-27 20:20:30 -07:00
Krrish Dholakia
9909b1d70a
fix(utils.py): add coverage for anthropic content policy error - vertex ai
2024-06-27 20:20:30 -07:00
Krrish Dholakia
c45d93b93a
fix(router.py): improve error message returned for fallbacks
2024-06-27 20:20:30 -07:00
Ishaan Jaff
b3ef4755c3
fix using mock completion
2024-06-27 20:20:30 -07:00
Ishaan Jaff
61b9ff9ac2
test - test_mock_request_n_greater_than_1
2024-06-27 20:20:30 -07:00
Ishaan Jaff
d07f8b6d3b
feat - use n in mock completion
2024-06-27 20:20:30 -07:00
Krrish Dholakia
81fd42258c
docs(reliability.md): add doc on mock testing fallbacks
2024-06-27 20:20:30 -07:00
Krrish Dholakia
9b47ba72cb
feat(router.py): support mock testing content policy + context window fallbacks
2024-06-27 20:20:30 -07:00
Ishaan Jaff
6a6b8613ea
ci/cd run again
2024-06-27 20:20:30 -07:00
Ishaan Jaff
48b8345ae6
docs nvidia_nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
22b7c0333d
docs - add nvidia nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
ee0d8341b0
test - nvidia nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
a9f17d141c
feat - add param mapping for nvidia nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
11ea1474b1
feat - add nvidia nim to main.py
2024-06-27 20:20:30 -07:00
Ishaan Jaff
b55c31ec3f
add nvidia nim to __init__
2024-06-27 20:20:30 -07:00
Ishaan Jaff
e471aca81f
feat - add debug_utils
2024-06-27 20:20:30 -07:00
Krish Dholakia
c18b8bb011
Update README.md
2024-06-27 20:20:30 -07:00
Krish Dholakia
43e42389d7
Update README.md
2024-06-27 20:20:30 -07:00
Kyrylo Yefimenko
1946610efd
Fix Groq prices
2024-06-27 20:20:30 -07:00
corrm
2e7b0096d0
Improve ollama prompt: this formula give good result with AutoGen
2024-06-27 20:20:30 -07:00
corrm
ec36dd40d7
Rename ollama prompt:
...
- 'Function' word to 'FunctionName'
- 'Tool Call' to `FunctionCall`
- 'Tool Call Result' to 'FunctionCall Result'
_I found that changes make some models better_
2024-06-27 20:20:30 -07:00
Islam Nofl
cc261580ac
Rename ollama prompt 'Function' word to 'Name'
2024-06-27 20:20:30 -07:00
corrm
a7efb9c332
Added improved function name handling in ollama_async_streaming
2024-06-27 20:20:30 -07:00
corrm
5d5227294d
chore: Improved OllamaConfig get_required_params and ollama_acompletion and ollama_async_streaming functions
2024-06-27 20:20:30 -07:00
corrm
e1e8f5a00e
chore: Improved prompt generation in ollama_pt function
2024-06-27 20:20:30 -07:00
Krrish Dholakia
bb64c68daf
docs(routing.md): add quickstart
2024-06-27 20:20:30 -07:00
Krrish Dholakia
673696222d
fix(langfuse.py): cleanup
2024-06-27 20:20:30 -07:00
Ishaan Jaff
4d7b2e578c
bump: version 1.40.25 → 1.40.26
2024-06-27 20:20:30 -07:00
Ishaan Jaff
c5020878e4
/spend/calculate use model aliases on this endpoint
2024-06-27 20:20:30 -07:00
Ishaan Jaff
08f83e6392
test - aliases on /spend/calculate
2024-06-27 20:20:30 -07:00
Krrish Dholakia
690c7f6e47
fix(router.py): log rejected router requests to langfuse
...
Fixes issue where rejected requests weren't being logged
2024-06-27 20:20:30 -07:00
Ishaan Jaff
7a961e8a0b
docs control available public routes
2024-06-27 20:20:30 -07:00