ginnoir/llm-router
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5 Commits 1 Branch 0 Tags
ab0cd4fe85f21ab31e2fc931f9774e03e891f7bf
Commit Graph
4 Commits
Author SHA1 Message Date
Joseph CostaandClaude Opus 4.8 ab0cd4fe85 Support a remote ComfyUI via a .env config file 
- run.sh / run.ps1: load an optional .env for host-specific env vars
- .env.example + docs: ComfyUI can run on another host (ROUTER_COMFYUI)
- .gitignore: .env

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-05 03:21:30 -05:00
Joseph CostaandClaude Opus 4.8 2f95e6be96 Add ComfyUI image generation (/v1/images/generations) 
OpenAI-compatible image endpoint that proxies to a ComfyUI server: fills a
workflow template with per-request params (prompt/size/n/seed/steps/checkpoint),
submits to ComfyUI, polls history, fetches images, returns OpenAI image shape.

- router.py: _handle_image + fill_workflow + route; env ROUTER_COMFYUI /
  ROUTER_COMFY_CHECKPOINT / ROUTER_COMFY_WORKFLOW
- comfyui-workflow.json: default SD/SDXL text2img template with {{SENTINELS}}
- docs/IMAGES.md + README: config, usage, custom workflows
- verified: templating + clean error when ComfyUI is down; end-to-end pending
  a live ComfyUI

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-05 03:14:51 -05:00
Joseph CostaandClaude Opus 4.8 95da8fb38d Add Windows (PowerShell) support 
- scripts/setup.ps1, scripts/pull-models.ps1, run.ps1 — PowerShell equivalents
  of the bash setup/pull/run scripts
- README + docs/DEPLOY.md: Windows quickstart and Task Scheduler autostart

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-05 02:12:02 -05:00
Joseph CostaandClaude Opus 4.8 9938d46a67 Initial commit: llm-router — smart OpenAI/Anthropic/Ollama router 
A stdlib pre-router in front of Ollama with LiteLLM backend:
- auto model selection by content/tools/modality, with fallbacks
- OpenAI /v1, Anthropic /v1/messages, and Ollama-native /api/* endpoints
- Whisper-shaped /v1/audio/transcriptions + in-chat audio
- key-based fleet policies (e.g. force a client onto uncensored models)
- optional Bearer auth; launchd/systemd service install
- benchmark harnesses (speed, quality, agentic tool use) with sample results

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-05 02:05:16 -05:00