Commit graph

30 commits

Author SHA1 Message Date
Parham Alvani
4de3d9f2a6 fix: we need to have project files for running migration using this image (#13379) 2025-08-07 17:08:58 -07:00
Krrish Dholakia
63757c4230 Squashed commit of the following:
commit 2ee8513763
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Sat Aug 2 23:03:57 2025 -0700

    fix(key_management_endpoints.py): fix check

commit 271fce9f39
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Sat Aug 2 23:01:46 2025 -0700

    build: update poetry

commit 9aeca96c16
Author: Jugal D. Bhatt <55304795+jugaldb@users.noreply.github.com>
Date:   Sat Aug 2 22:37:02 2025 -0700

    fix openshift (#13239)

commit 3119064e94
Author: Krish Dholakia <krrishdholakia@gmail.com>
Date:   Sat Aug 2 22:33:37 2025 -0700

    Prompt Management - add prompts on UI  (#13240)

    * fix(create_key_button.tsx): add prompts on UI

    * feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

    * fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

    * fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

    prevent accidental clicking

    * fix(create_key_button.tsx): disable premium features behind flag, prevent errors

    * feat(prompts.tsx): add new ui component to view created prompts

    enables viewing prompts created on config

    * feat(prompt_info.tsx): add component for viewing the prompt information

    * feat(prompt_endpoints.py): support converting dotprompt to json structure + accept json structure in promptmanager

    allows prompt manager to work with api endpoints

    * test(test_prompt_manager.py): add unit tests for json data input

    * feat(dotprompt/__init__.py): add prompt data to dotpromptmanager

    * fix(prompt_endpoints.py): working crud endpoints for prompt management

    * feat(prompts/): support `prompt_file` for dotprompt

    allows to precisely point to the prompt file a prompt should use

    * feat(proxy/utils.py): resolve prompt id correctly

    resolves user sent prompt id with internal prompt id

    * feat(schema.prisma): initial pr with db schema for prompt management table

    allows post endpoints to work with backend

    * feat(prompt_endpoints.py): use db in patch_prompt endpoint

    * feat(prompt_endpoints.py): use db for update_prompt endpoint

    * feat(prompt_endpoints.py): use db on prompt delete endpoint

    * build(schema.prisma): add prompt tale to schema.prisma in litellm-proxy-extras

    * build(migration.sql): add new sql migration file

    * fix(init_prompts.py): fix init

    * feat(prompt_info_view.tsx): show the raw prompt template on ui

    allows developer to know the prompt template they'll be calling

    * feat(add_prompt_form.tsx): working ui add prompt flow

    allows user to add prompts to litellm via ui

    * build(ui/): styling fixes

    * build(ui/): prompts.tsx

    styling improvements

    * fix(add_prompt_form.tsx): styling improvements

    * build(prompts.tsx): styling improvements

    * build(ui/): styling improvements

    * build(ui/): fix ui error

    * fix: fix ruff check

    * docs: document new api params

    * test: update tests

commit e47b30a76d
Author: Krish Dholakia <krrishdholakia@gmail.com>
Date:   Sat Aug 2 19:34:18 2025 -0700

    Prompt Management - Add table + prompt info page to UI  (#13232)

    * fix(create_key_button.tsx): add prompts on UI

    * feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

    * fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

    * fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

    prevent accidental clicking

    * fix(create_key_button.tsx): disable premium features behind flag, prevent errors

    * feat(prompts.tsx): add new ui component to view created prompts

    enables viewing prompts created on config

    * feat(prompt_info.tsx): add component for viewing the prompt information

commit b79f55eec0
Author: Krish Dholakia <krrishdholakia@gmail.com>
Date:   Sat Aug 2 19:33:17 2025 -0700

    UI - Add giving keys prompt access (#13233)

    * fix(create_key_button.tsx): add prompts on UI

    * feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

    * fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

    * fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

    prevent accidental clicking

    * fix(create_key_button.tsx): disable premium features behind flag, prevent errors

    * fix(key_management_endpoints.py): fix key update logic \

    * fix: fix check

    * docs: document new params

commit 4c217c66f5
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 17:26:40 2025 -0700

    docs User Agent Activity Tracking

commit 2ee4e84406
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 16:47:44 2025 -0700

    docs fix

commit 06856b4d37
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 15:47:09 2025 -0700

    docs fix

commit 0f9f5f7a6c
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 15:44:59 2025 -0700

    docs fix

commit 69a360429c
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 15:34:14 2025 -0700

    agent 4.png

commit e32169dc37
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 15:29:44 2025 -0700

    docs cost tracking coding

commit 340b64a46a
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 15:18:04 2025 -0700

    docs - Track Usage for Coding Tools

commit 9b029c35be
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 15:06:12 2025 -0700

    docs RC

commit 8d6b333909
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 15:00:48 2025 -0700

    docs computer use

commit e306fb6eee
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 14:15:10 2025 -0700

    [docs release notes] (#13237)

    * docs release notes

    * docs release notes

    * docs rnotes

    * docs api version

    * fixes docs

    * docs rn

commit 5dfc88473f
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 13:30:51 2025 -0700

    fixes MCP gateway docs

commit 6929767be2
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Sat Aug 2 12:56:00 2025 -0700

    docs release notes
2025-08-05 22:14:14 -07:00
Mateo Di Loreto
6e5fe51184
add openssl in apk install in runtime stage in dockerfile.non_root (#13168)
* add openssl in apk install in runtime stage in dockerfile.non_rootdocker-compose logs -f litellm

* Improve Docker-compose.yaml for local debugging

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-07-31 21:52:11 -07:00
Ishaan Jaff
106a298f0a
[Feat] UI - Allow Adding LiteLLM Auto Router on UI (#12960)
* add router.json

* test_router_auto_router

* async_pre_routing_hook

* fixes for auto router

* add async_pre_routing_hook

* add LiteLLMRouterEncoder

* update test auto_router_embedding_model

* add auto_router_embedding_model

* add AutoRouter

* fix async_pre_routing_hook

* update async_pre_routing_hook

* fix auto router

* fix router.json

* working router init

* working embedding encoder

* working auto router

* test_router_auto_router

* test auto router

* add semantic-router as optional for litellm

* add extras

* semantic_router==0.1.10

* ruff fix

* use aiohttp==3.10.11

* python-dotenv==1.0.1

* test auto router

* test_router_auto_router

* semantic_router

* test_is_auto_router_deployment

* fix check

* fix docker build step

* add semantic_router

* UI  - Add auto router on litellm

* working utterances config

* fix route config builder

* kind of working add automodel router

* move loc of add deployment

* fixes for AutoRouter

* add auto_router_config in types.py

* fixes for init_auto_router_deployment

* fix adding auto router models

* working auto-router with dB

* Revert "add semantic_router"

This reverts commit 537b672887.

* TestAutoRouter

* fix linting

* add semantic router to docker

* test fix

* fix router config builder

* remove export button
2025-07-24 19:58:49 -07:00
Jugal D. Bhatt
aa1ebf37b2
pass in cmd args (#12871) 2025-07-22 14:10:23 -07:00
Mateo Di Loreto
c65392cf81
Replace non-root Dockerfile base with Alpine multi-stage build; (#12707)
* Change Dockerfile.noon_root with alpine base image

* Improve non_root docker image

* Re add the build_admin_ui.sh script step

* Re add the build_admin_ui.sh script step

* Remove unnecessary workdir set

* Remove unnecessary workdir set

* Configure chainguard image

* A bit of optimization and improve comments

* delete extra build_ui script run

* Optimizie Dockerfile copy statements
2025-07-22 08:53:10 -07:00
Jugal D. Bhatt
a112ec5b02
Health check app on separate port (#12718)
* add separate health app

* add new docs

* refactor

* fix colons

* Update config_settings.md

* refactor

* docs

* add unit test

* added supervisord

* remove app

* add supervisor conf

* Add markdown

* add video to md

* remove test

* docs build failure

* add to all docker files, change prod.md and add tests

* change dockerfiles

* remove extra file

* remove extra file

* remove extra file

* change apt->apk

* remove rdb file

* add fixed file
2025-07-18 11:17:15 -07:00
Ishaan Jaff
82a03fd163 fixes build from pip 2025-06-14 09:03:50 -07:00
Ishaan Jaff
9ebe47bee9 fix build from pip 2025-06-14 08:58:01 -07:00
Ishaan Jaff
a32b372293 fix build from pip 2025-06-14 08:50:14 -07:00
Ishaan Jaff
95bf272832 fix build from pip 2025-06-14 08:46:44 -07:00
Ishaan Jaff
b1e00b3724 build from pip RUN prisma generate 2025-06-14 08:37:47 -07:00
Ishaan Jaff
209362664f add Dockerfile.dev 2025-06-03 12:03:52 -07:00
Ishaan Jaff
2be334eeb1 fix build from pip test 2025-04-26 19:36:47 -07:00
Peter Dave Hello
6b67006b0c
Remove redundant apk update in Dockerfiles (cc #5016) (#9055)
The `apk` commands can utilize the `--no-cache` option, making the
`update` step superfluous and ensuring the latest packages are used
without maintaining a local cache. An additional `apk update` in the
Dockerfile will just make the image larger with no benefits.
2025-04-08 09:03:25 -07:00
Tyler Hutcherson
7864cd1f76 update redisvl dependency 2025-03-24 08:42:11 -04:00
Peter Dave Hello
c6026ea6f9
Optimize Alpine Dockerfile by removing redundant apk commands (#5016)
Remove unnecessary `apk update` and manual cache cleanup steps in the
Alpine Dockerfile. By using `apk add --no-cache`, we avoid manual cache
management, making the Dockerfile simpler and easier to maintain.
2025-02-15 08:55:12 -08:00
Ishaan Jaff
9b944ca60c
(Fix + Testing) - Add dd-trace-run to litellm ci/cd pipeline + fix bug caused by dd-trace patching OpenAI sdk (#7820)
* add dd trace to e2e docker run tests

* update dd trace v

* fix entrypoint

* dd trace fixes

* proxy_build_from_pip_tests

* build python3.13

* use py 3.13

* fix build from pip

* dd trace fix

* proxy_build_from_pip_tests

* bump build from pip
2025-01-16 22:03:09 -08:00
Krish Dholakia
d4ed985173
Add back in non root image fixes (#7781) (#7795)
* Add back in non root image fixes (#7781)

* Add back in non root image fixes

* Fix dockerfile

* Fix perms

* Add in container structure tests for the nonroot image (#7796)

* feat(helm): add securityContext and pull policy values to migration job (#7652)

* fix(helm): corrected indentation in migration-job.yaml

* feat(helm): add securityContext and pull policy values to migration job

* fix confusing save button label (#7778)

* [integrations/lunary] Improve Lunary documentaiton (#7770)

* update lunary doc

* better title

* tweaks

* Update langchain.md

* Update lunary_integration.md

* Fix wrong URL for internal user invitation (#7762)

* format

* done

* Update instructor tutorial (#7784)

* Add in container structure tests for the nonroot image

---------

Co-authored-by: Zackeus Bengtsson <32719220+Hexoplon@users.noreply.github.com>
Co-authored-by: yujonglee <yujonglee.dev@gmail.com>
Co-authored-by: Hugues Chocart <chocart.hugues@icloud.com>
Co-authored-by: Nikolaiev Dmytro <dima.nikol.99@gmail.com>

---------

Co-authored-by: Rajat Vig <rajatvig@users.noreply.github.com>
Co-authored-by: Zackeus Bengtsson <32719220+Hexoplon@users.noreply.github.com>
Co-authored-by: yujonglee <yujonglee.dev@gmail.com>
Co-authored-by: Hugues Chocart <chocart.hugues@icloud.com>
Co-authored-by: Nikolaiev Dmytro <dima.nikol.99@gmail.com>
2025-01-15 21:49:03 -08:00
Ishaan Jaff
fd0a03f719
(feat) - allow building litellm proxy from pip package (#7633)
* fix working build from pip

* add tests for proxy_build_from_pip_tests

* doc clean up for deployment

* docs cleanup

* docs build from pip

* fix cd docker/build_from_pip
2025-01-08 16:36:57 -08:00
Ishaan Jaff
60c89a3e8a
(Fix) security of base image (#7620)
* fix security of base images

* fix dockerfile
2025-01-07 20:35:57 -08:00
Ishaan Jaff
6125ba1e2b
(Feat) - allow including dd-trace in litellm base image (#7587)
* introduce USE_DDTRACE=true

* update dd tracer

* update

* bump dd trace

* use og slim image

* DD tracing

* fix _init_dd_tracer
2025-01-06 17:27:09 -08:00
Ishaan Jaff
564ecc728d
(security fix) - update base image for all docker images to python:3.13.1-slim (#7388)
* update base image for all docker files

* remove unused files

* fix sec vuln
2024-12-23 16:20:47 -08:00
Ishaan Jaff
d1760b1b04
(fix) clean up root repo - move entrypoint.sh and build_admin_ui to /docker (#6110)
* fix move docker files to docker folders

* move check file length

* fix docker hub deploy

* fix clean up root

* fix circle ci config
2024-10-08 11:34:43 +05:30
Ishaan Jaff
5de69cb1b2 fix using Dockerfile 2024-10-08 08:45:40 +05:30
Ishaan Jaff
d742e8cb43
(clean up) move docker files from root to docker folder (#6109)
* fix move docker files to docker folders

* move check file length

* fix docker hub deploy
2024-10-08 08:23:52 +05:30
ishaan-jaff
357c6c56bd Revert "build(Dockerfile): move prisma build to dockerfile"
This reverts commit 2741835605.
2024-01-06 09:51:44 +05:30
Krish Dholakia
b4901e6dea
Update .env.example 2024-01-05 19:14:48 +05:30
Krrish Dholakia
2741835605 build(Dockerfile): move prisma build to dockerfile
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
2024-01-05 19:03:41 +05:30
Krrish Dholakia
14e501845f fix(proxy_server.py): add support for setting master key via .env 2024-01-03 15:10:25 +05:30