2 Commits

Include renames

Author	SHA1	Message	Date
ginnoirandClaude Opus 4.8	605c6d3709	fix(llm): use --flash-attn on (this llama.cpp build requires explicit value) ... The server-cuda image parses -fa as --flash-attn [on|off|auto], so a bare -fa swallowed the following --cache-type-k as its value and crash-looped. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>	2026-06-26 16:31:01 -05:00
ginnoirandClaude Opus 4.8	8e7682985d	feat(llm): add llama.cpp inference stack for Hermes (Qwen2.5-14B on P100) ... New stacks/llm/ serves Qwen2.5-14B-Instruct (Q4_K_M GGUF) via llama.cpp's OpenAI-compatible server on the Tesla P100 (CDI nvidia.com/gpu=0), published on 172.20.0.1:8090 for the host-side Hermes agent. vLLM was rejected: the P100 (cc 6.0) lacks the DP4A INT8 instructions its AWQ/GPTQ kernels need. Includes design spec and implementation plan under docs/superpowers/. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>	2026-06-26 16:22:57 -05:00