Secure and Efficient LLM router · management console
Changes apply immediately to the running router. Use Save config to write them to disk.
Add, edit, or remove LLM providers at runtime. Use Save config to persist to disk.
| Name | Model | Kind | Status | Requests | Success | Latency | Cost /1k | Enabled | Actions |
|---|
OpenAI-compatible endpoint used only for semantic prompt compression before the main model (Ollama, vLLM, LM Studio, etc.).
OpenAI-compatible endpoint used only for PII filtering before the main model (Ollama, vLLM, LM Studio, etc.).