scriptoriumadmin/strix
1
0
Fork 0
mirror of https://github.com/usestrix/strix.git synced 2026-11-14 09:01:25 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

docs: align local model fallback context

Browse source
This commit is contained in:
Ousama Ben Younes 2026-07-27 19:58:18 +00:00
parent f80444b4e0
commit b27f22ce08
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
docs/llm-providers/local.mdx
View file

@ -62,6 +62,7 @@ Then build and select that local variant:
ollama create qwen3-vl-64k -f Modelfile
export STRIX_LLM="ollama/qwen3-vl-64k"
export LLM_API_BASE="http://localhost:11434"
export STRIX_CONTEXT_FALLBACK_TOKENS="65536"
```
You can also set `num_ctx` on OpenAI-compatible local servers that expose runtime parameters. In LM Studio, set the context length in the model settings before starting the local server. In llama.cpp, start the server with an explicit context size:
@ -72,6 +73,8 @@ llama-server --ctx-size 65536 --model /path/to/model.gguf
Larger context windows require more VRAM and RAM. If the model becomes slow or fails to load, lower the scan mode first, then lower the context window. Avoid using a 4k or 8k context for real scans; it is usually too small for Strix's agent workflow.
When you use a custom local model name, keep `STRIX_CONTEXT_FALLBACK_TOKENS` aligned with the server's configured context size. This prevents Strix from assuming a larger unknown-model fallback window and compacting too late.
### Context Clipping Symptoms
These symptoms usually mean the local model is clipping or losing context: