A stdlib pre-router in front of Ollama with LiteLLM backend: - auto model selection by content/tools/modality, with fallbacks - OpenAI /v1, Anthropic /v1/messages, and Ollama-native /api/* endpoints - Whisper-shaped /v1/audio/transcriptions + in-chat audio - key-based fleet policies (e.g. force a client onto uncensored models) - optional Bearer auth; launchd/systemd service install - benchmark harnesses (speed, quality, agentic tool use) with sample results Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
10 lines
500 B
Plaintext
10 lines
500 B
Plaintext
Copy this file to `.uncensored_key` and put a single secret token in it.
|
|
Any request whose `Authorization: Bearer <token>` matches this value is FORCED
|
|
onto the uncensored model fleet, regardless of the model it asks for. Use it to
|
|
pin a specific client (e.g. a family assistant app) to uncensored models.
|
|
|
|
This is independent of `.apikey` — the router can be open (no auth) and still
|
|
honor this key to switch a client to the uncensored fleet.
|
|
|
|
Generate one: echo "famapp-$(openssl rand -hex 16)"
|