Commit graph

45043 commits

Author SHA1 Message Date
ishaan-jaff
a46d6a2dc9 (test) add bedrock/amazon.titan-embed-text-v1 2023-11-01 13:55:28 -07:00
ishaan-jaff
2ad81bdd7b (feat) embedding() add bedrock/amazon.titan-embed-text-v1 2023-11-01 13:55:28 -07:00
Krrish Dholakia
8deeb52f7c docs(function_call.md): cleanup 2023-11-01 13:55:00 -07:00
Krrish Dholakia
fb4be198ee docs(routing.md): adding context window fallback dict and num retries 2023-11-01 13:52:18 -07:00
ishaan-jaff
270fc02578 (docs) add litellm.api_version 2023-11-01 11:52:20 -07:00
ishaan-jaff
d72cd8576e (test) use litellm.api_version 2023-11-01 11:52:01 -07:00
ishaan-jaff
317c290b69 (test) add num retries to caching testing 2023-11-01 11:42:40 -07:00
ishaan-jaff
01d90691f9 (docs) add num_retries to docstring 2023-11-01 10:55:56 -07:00
ishaan-jaff
70885bdba6 (test) stream chunk builder 2023-11-01 08:38:19 -07:00
Krish Dholakia
d898b1c412
Merge pull request #734 from morgendigital/patch-1
Docker Hub image is built for ARM64 only
2023-11-01 08:21:45 -07:00
Ishaan Jaff
66850479cd
Merge pull request #741 from stanfea/main
Use supplied headers
2023-11-01 08:08:12 -07:00
stefan
bbc82f3afa Use supplied headers 2023-11-01 20:31:16 +07:00
ishaan-jaff
f6983223f9 (test) track usage in custom callback streaming 2023-10-31 23:05:42 -07:00
ishaan-jaff
d1f2593dc0 (fix) add usage tracking in callback 2023-10-31 23:02:54 -07:00
ishaan-jaff
522f1ac7c8 (docs) bedrock 2023-10-31 22:32:41 -07:00
Krrish Dholakia
7762ae7762 feat(utils.py): accept context window fallback dictionary 2023-10-31 22:32:36 -07:00
ishaan-jaff
2f6fed30ad (test) bedrock.cohere testing 2023-10-31 22:26:43 -07:00
ishaan-jaff
fa7e063198 (feat) add bedrock.cohere streaming 2023-10-31 22:26:43 -07:00
Krrish Dholakia
0ffb1dcc38 test(test_completion_with_retries.py): cleanup tests 2023-10-31 21:49:33 -07:00
Krrish Dholakia
f3efd566c9 style(main.py): fix linting issues 2023-10-31 19:23:14 -07:00
Krrish Dholakia
125642563c feat(completion()): adding num_retries
https://github.com/BerriAI/litellm/issues/728
2023-10-31 19:14:55 -07:00
ishaan-jaff
cedc756d2e (docs) hf viewing log probs 2023-10-31 18:37:18 -07:00
Krrish Dholakia
6ead8d8c18 fix(caching.py): fixing pr issues 2023-10-31 18:32:40 -07:00
ishaan-jaff
c0e6596395 (docs) hf 2023-10-31 18:25:44 -07:00
ishaan-jaff
f016234cbf (test) text_completion add echo for hf 2023-10-31 18:20:59 -07:00
ishaan-jaff
ce462824be (feat) add support for echo for HF logprobs 2023-10-31 18:20:59 -07:00
Krrish Dholakia
847de09308 docs(simple_proxy.md): add model alias to docs 2023-10-31 17:30:02 -07:00
Krish Dholakia
5a2a9baa78
Update README.md 2023-10-31 17:19:56 -07:00
ishaan-jaff
e180bba541 (test) text completion add logprobs to test 2023-10-31 17:15:35 -07:00
ishaan-jaff
9223f7cc7a (feat) textcompletion - transform hf log probs to openai text completion 2023-10-31 17:15:35 -07:00
ishaan-jaff
b32cedeb28 (docs) function calling for non openai llms 2023-10-31 17:15:35 -07:00
Krrish Dholakia
4d95756432 test(test_completion.py): re-add bedrock + sagemaker testing 2023-10-31 16:49:13 -07:00
Krish Dholakia
523c08a646
Merge pull request #717 from canada4663/main
support for custom bedrock runtime endpoint
2023-10-31 16:47:33 -07:00
Krish Dholakia
9bef396d04
Merge pull request #722 from karvetskiy/fix-router-caching
Fix caching for Router
2023-10-31 16:39:18 -07:00
ishaan-jaff
85692398c1 (test) add support for returning logprobs 2023-10-31 15:33:45 -07:00
ishaan-jaff
1ada3a13d4 (feat) text_completion return raw response for davinci003 2023-10-31 15:32:04 -07:00
ishaan-jaff
de47058e32 (feat) text_completion return raw openai response for text_completion requests 2023-10-31 15:31:24 -07:00
Morgendigital
3c49949e0b
Docker Hub image is built for ARM64 only
When trying to run it on a x64 Linux machine, I get the following error:

```
WARNING: The requested image's platform (linux/arm64) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested
```

The Docker image was apparently built for ARM64 only.
2023-10-31 23:28:38 +01:00
ishaan-jaff
4875af17a1 (fix) linting errors 2023-10-31 14:43:10 -07:00
ishaan-jaff
b301e4ead7 (test) text_completion pass prompt as array 2023-10-31 14:29:43 -07:00
ishaan-jaff
b4e14aed6b (feat) text_completion add support for passing prompt as array 2023-10-31 14:29:43 -07:00
Krish Dholakia
730fd28286
Merge pull request #729 from mc-marcocheng/router/empty_str
Router.get_available_deployment: Handle empty input edge case
2023-10-31 08:01:37 -07:00
mc-marcocheng
0a2cb9555c Handle empty input edge case 2023-10-31 14:38:04 +08:00
Krrish Dholakia
caa199d851 test: removing unstable tests 2023-10-30 21:10:36 -07:00
Krrish Dholakia
9a0c785741 test(test_async_fn.py): fix import issues 2023-10-30 20:57:24 -07:00
Krrish Dholakia
3743893e76 fix(main.py): removing print_verbose 2023-10-30 20:37:12 -07:00
Krrish Dholakia
c04cad208c test(test_sentry.py): fix testing 2023-10-30 20:21:40 -07:00
ishaan-jaff
0089442341 (test) add func to prompt 2023-10-30 20:06:06 -07:00
ishaan-jaff
ad2b75a8cc (test) fix test test_exception_tracking 2023-10-30 20:05:37 -07:00
Krrish Dholakia
9c70da56df test(test_async_fn.py): test logging 2023-10-30 19:59:36 -07:00