mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-07 02:59:05 +00:00
02c1c45b53
A coding agent names each conversation by quoting the whole session and asking for a title. The classifier rated the quoted session rather than the request, so the cheapest call the client makes routed to the most expensive tier: 11 of 17 title generations in one day of real traffic came back COMPLEX. Recognize those prompts by literal sentinel on the newest ask and route them to the cheapest configured tier without classifying them, so the call costs nothing to route. The placement is scoped to the one request that carries the sentinel: it never displaces an operator's classifier plugin, the bandit cannot reach above the tier as raised, it never becomes the session pin, and the sentinel that matched is recorded on the routing decision. Detection reads the newest ask alone, so a title request quoted into a later turn cannot cheapen the work that follows it, and a keyword rule, an escalation keyword or the plan-mode floor all still decide over it. Regenerates the lazy OpenAPI snapshot, which was already stale on the base for an unrelated Presidio guardrail field and failed the schema check on every PR. Resolves LIT-6349 |
||
|---|---|---|
| .. | ||
| public | ||
| scripts | ||
| src | ||
| tests | ||
| .env.development | ||
| .env.production | ||
| .npmrc | ||
| .nvmrc | ||
| .prettierignore | ||
| .prettierrc | ||
| build_release_ui.sh | ||
| build_ui.sh | ||
| build_ui_custom_path.sh | ||
| CLAUDE.md | ||
| components.json | ||
| eslint-budgets.json | ||
| eslint-suppressions.json | ||
| eslint.config.mjs | ||
| knip.json | ||
| next.config.mjs | ||
| package-lock.json | ||
| package.json | ||
| postcss.config.js | ||
| README.md | ||
| tsconfig.json | ||
| tsconfig.tsbuildinfo | ||
| vitest.config.ts | ||
This is a Next.js project bootstrapped with create-next-app.
Getting Started
First, run the development server:
npm run dev
# or
yarn dev
# or
pnpm dev
# or
bun dev
Open http://localhost:3000 with your browser to see the result.
You can start editing the page by modifying app/page.tsx. The page auto-updates as you edit the file.
This project uses next/font to automatically optimize and load Inter, a custom Google Font.
Learn More
To learn more about Next.js, take a look at the following resources:
- Next.js Documentation - learn about Next.js features and API.
- Learn Next.js - an interactive Next.js tutorial.
You can check out the Next.js GitHub repository - your feedback and contributions are welcome!
Deploy on Vercel
The easiest way to deploy your Next.js app is to use the Vercel Platform from the creators of Next.js.
Check out our Next.js deployment documentation for more details.