265b407e8dc5648a6ad2fa1c4cb4212201f74276
Hermes Agent rejects models with <64K context. Qwen2.5-14B is 32k native, so enable YaRN rope-scaling (2x → 65536) and drop the V-cache to q4_0 for VRAM headroom on the 16GB P100. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
homelabstack
Languages
Python
54.5%
Shell
18.5%
PowerShell
16%
JavaScript
5.5%
HTML
4.7%
Other
0.7%