46528 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Ishaan Jaff	d54de58e31	Merge pull request #1197 from Rested/main ... docker build and push on release	2023-12-21 07:28:17 +05:30
ishaan-jaff	3e5cfee1f4	(ci/cd) run again	2023-12-21 07:25:22 +05:30
ishaan-jaff	b701a356cc	(fix) vertex ai auth file	2023-12-21 07:22:25 +05:30
Krrish Dholakia	6795f0447a	fix(utils.py): fix non_default_param pop error for ollama	2023-12-21 06:59:13 +05:30
David Manouchehri	93c4556eb0	Add aws_bedrock_runtime_endpoint support.	2023-12-20 19:31:43 -05:00
Graham Neubig	6e9267ca66	Make vertex_chat work with generate_content	2023-12-20 15:32:44 -05:00
Mateo Cámara	b72d372aa7	feat: added explicit args to acomplete	2023-12-20 19:49:12 +01:00
Graham Neubig	482b3b5bc3	Add a default for safety settings in vertex AI	2023-12-20 13:12:50 -05:00
Krrish Dholakia	04bbd0649f	fix(router.py): only do sync image gen fallbacks for now ... The customhttptransport we use for dall-e-2 only works for sync httpx calls, not async. Will need to spend some time writing the async version n	2023-12-20 19:10:59 +05:30
Reuben Thomas-Davis	fe4427907d	🗑️ remove unused docker workflow for clarity	2023-12-20 12:41:23 +00:00
Reuben Thomas-Davis	50af89e853	💚 docker build and push on release ... when a github release is published a docker image is pushed to ghcr avoiding manual workflow dispatch method (but still making it available as a fallback)	2023-12-20 12:40:43 +00:00
Krrish Dholakia	350389f501	fix(utils.py): add support for anyscale function calling	2023-12-20 17:48:33 +05:30
Krrish Dholakia	4040f60feb	feat(router.py): support async image generation on router	2023-12-20 17:24:20 +05:30
Krrish Dholakia	f355e03515	feat(main.py): add async image generation support	2023-12-20 16:58:40 +05:30
Krrish Dholakia	f59b9436be	feat(main.py): add async image generation support	2023-12-20 16:58:15 +05:30
Krrish Dholakia	b3962e483f	feat(azure.py): add support for azure image generations endpoint	2023-12-20 16:37:21 +05:30
AllentDan	6b19db0327	fix least_busy router by updating min_traffic	2023-12-20 18:16:00 +08:00
Krrish Dholakia	f0df28362a	feat(ollama.py): add support for ollama function calling	2023-12-20 14:59:55 +05:30
ishaan-jaff	bab8f3350d	(docs) openrouter	2023-12-20 13:42:49 +05:30
ishaan-jaff	7d20ea23d1	(docs) set openrouter params	2023-12-20 13:42:49 +05:30
ishaan-jaff	683a1ee979	(feat) proxy key/generate pass metadata in requests	2023-12-20 13:42:49 +05:30
ishaan-jaff	7ad21de441	(feat) proxy /key/generate add metadata to _types	2023-12-20 13:42:49 +05:30
ishaan-jaff	c4b7ab6579	(feat) proxy - add metadata for keys	2023-12-20 13:42:49 +05:30
Krish Dholakia	93c4efd715	Merge pull request #1190 from neubig/add_vertexai_safety_settings ... Add partial support of VertexAI safety settings	2023-12-20 07:31:10 +00:00
Ishaan Jaff	9fa2fe0c37	Merge pull request #1185 from navidre/prevent_key_log_documentation ... Sample code to prevent logging API key in callback to Slack	2023-12-20 09:09:10 +05:30
ishaan-jaff	229b56fc35	(docs) swagger - add embedding tag	2023-12-20 09:04:56 +05:30
Graham Neubig	2d15e5384b	Add partial support of vertexai safety settings	2023-12-19 22:26:55 -05:00
ishaan-jaff	aa78415894	(docs) swager - add embeddings tag	2023-12-20 06:29:36 +05:30
ishaan-jaff	9548334e2f	(docs) swagger docs add description	2023-12-20 06:27:26 +05:30
ishaan-jaff	8b26e64b5d	(fix) proxy: add link t swagger docs on startup	2023-12-20 06:02:05 +05:30
ishaan-jaff	cd34b859df	(docs) swagger endpoint	2023-12-20 05:49:45 +05:30
navidre	b8d7cafb8d	Sample code to prevent logging API key ... Sample code in documentation to prevent logging API key. Ideally should be implemented in the codebase if not already	2023-12-19 14:04:20 -06:00
Krrish Dholakia	c5340b8709	fix(utils.py): vertex ai exception mapping	2023-12-19 15:25:29 +00:00
Krrish Dholakia	5936664a16	fix(ollama.py): raise async errors	2023-12-19 15:01:12 +00:00
ishaan-jaff	9eb487efb3	(docs) exception mapping	2023-12-19 19:29:05 +05:30
ishaan-jaff	8b0fa2322c	(docs) exception mapping azure openai	2023-12-19 19:23:52 +05:30
ishaan-jaff	dbcff752b3	(docs) exception mapping - add more details	2023-12-19 19:22:51 +05:30
ishaan-jaff	84fde01461	(fix) docs proxy + auth curl request	2023-12-19 19:11:35 +05:30
ishaan-jaff	9995229b97	(fix) proxy + ollama - raise exception correctly	2023-12-19 18:48:34 +05:30
Max Deichmann	b93fe99b74	debug langfuse on env variable	2023-12-19 12:20:58 +01:00
Max Deichmann	a05a955653	add log	2023-12-19 10:06:03 +01:00
Max Deichmann	dc8ae16d84	add users	2023-12-19 09:54:51 +01:00
Max Deichmann	c397da7c59	changes	2023-12-19 09:41:49 +01:00
sumanth	96e23daf4d	fix	2023-12-19 13:15:48 +05:30
ishaan-jaff	ce1b0b89ba	(fix) proxy - health checks support cli model	2023-12-19 12:55:20 +05:30
ishaan-jaff	b82fcd51d7	(docs) ollama/llava	2023-12-19 11:32:28 +05:30
Krrish Dholakia	f73c4b494c	docs(model_management.md): adding docs on how to add model metadata in the config.yaml	2023-12-18 17:57:29 -08:00
Krish Dholakia	67112ea81d	Merge pull request #1168 from clevcode/main ... Fix for issue that occured when proxying to ollama	2023-12-18 17:54:59 -08:00
Krish Dholakia	408f232bd7	Merge branch 'main' into main	2023-12-18 17:54:34 -08:00
Krrish Dholakia	071283c102	fix(router.py): init deployment_latency_map even if model_list is empty	2023-12-18 17:50:26 -08:00