Joseph CostaandClaude Opus 4.8
9938d46a67
A stdlib pre-router in front of Ollama with LiteLLM backend: - auto model selection by content/tools/modality, with fallbacks - OpenAI /v1, Anthropic /v1/messages, and Ollama-native /api/* endpoints - Whisper-shaped /v1/audio/transcriptions + in-chat audio - key-based fleet policies (e.g. force a client onto uncensored models) - optional Bearer auth; launchd/systemd service install - benchmark harnesses (speed, quality, agentic tool use) with sample results Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
33 lines
1.0 KiB
XML
33 lines
1.0 KiB
XML
<?xml version="1.0" encoding="UTF-8"?>
|
|
<!-- macOS launchd user agent. Placeholders __INSTALL_DIR__ and __PATH__ are
|
|
filled in by deploy/install-service.sh. Do not install this template directly. -->
|
|
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
|
|
<plist version="1.0">
|
|
<dict>
|
|
<key>Label</key>
|
|
<string>com.llm-router</string>
|
|
<key>ProgramArguments</key>
|
|
<array>
|
|
<string>/bin/bash</string>
|
|
<string>__INSTALL_DIR__/run.sh</string>
|
|
</array>
|
|
<key>WorkingDirectory</key>
|
|
<string>__INSTALL_DIR__</string>
|
|
<key>RunAtLoad</key>
|
|
<true/>
|
|
<key>KeepAlive</key>
|
|
<true/>
|
|
<key>ThrottleInterval</key>
|
|
<integer>10</integer>
|
|
<key>StandardOutPath</key>
|
|
<string>__INSTALL_DIR__/launchd.out.log</string>
|
|
<key>StandardErrorPath</key>
|
|
<string>__INSTALL_DIR__/launchd.err.log</string>
|
|
<key>EnvironmentVariables</key>
|
|
<dict>
|
|
<key>PATH</key>
|
|
<string>__PATH__</string>
|
|
</dict>
|
|
</dict>
|
|
</plist>
|