Joseph CostaandClaude Opus 4.8
9938d46a67
A stdlib pre-router in front of Ollama with LiteLLM backend: - auto model selection by content/tools/modality, with fallbacks - OpenAI /v1, Anthropic /v1/messages, and Ollama-native /api/* endpoints - Whisper-shaped /v1/audio/transcriptions + in-chat audio - key-based fleet policies (e.g. force a client onto uncensored models) - optional Bearer auth; launchd/systemd service install - benchmark harnesses (speed, quality, agentic tool use) with sample results Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
17 lines
415 B
Plaintext
17 lines
415 B
Plaintext
# systemd user service (Linux). Placeholders filled by deploy/install-service.sh.
|
|
# Installed to ~/.config/systemd/user/llm-router.service
|
|
[Unit]
|
|
Description=llm-router — smart router in front of Ollama
|
|
After=network.target
|
|
|
|
[Service]
|
|
Type=simple
|
|
WorkingDirectory=__INSTALL_DIR__
|
|
ExecStart=/bin/bash __INSTALL_DIR__/run.sh
|
|
Restart=always
|
|
RestartSec=10
|
|
Environment=PATH=__PATH__
|
|
|
|
[Install]
|
|
WantedBy=default.target
|