cardosofelipe/strix-halo-optimizations
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(serve): upgrade daily driver to qwen3.6-35b-a3b q6_k_xl

Browse Source 
Switch `make serve` default to Qwen3.6 UD Q6_K_XL (32 GB, hybrid
DeltaNet, near-lossless) and register it in the model catalog. Add
--jinja to the llama-server launcher so tool/function calling works —
without it clients silently ignore tool definitions advertised by the
server.
This commit is contained in:
Felipe Cardoso
2026-04-26 20:06:18 +02:00
parent c847991740
commit 751180fdc1
3 changed files with 4 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
configs/models.conf
View File

@@ -27,6 +27,7 @@ qwen3.5-27b-opus-distill|Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distille
qwen3.5-35b-a3b-q4|unsloth/Qwen3.5-35B-A3B-GGUF|Qwen3.5-35B-A3B-UD-Q4_K_XL.gguf|21|moe|MoE 35B, 3B active, Unsloth dynamic XL
qwen3.5-35b-a3b-q8|unsloth/Qwen3.5-35B-A3B-GGUF|Qwen3.5-35B-A3B-Q8_0.gguf|37|moe|MoE 35B Q8, near-full precision
qwen3.5-35b-a3b-apex-compact|mudler/Qwen3.5-35B-A3B-Claude-Distilled-APEX-GGUF|Qwen3.5-35B-A3B-Claude-Distilled-APEX-I-Compact.gguf|17|moe|MoE 35B Claude-distilled APEX, I-Compact quant
qwen3.6-35b-a3b-q6xl|unsloth/Qwen3.6-35B-A3B-GGUF|Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf|32|moe|Qwen3.6 MoE 35B/3B active, UD Q6 XL (near-lossless, hybrid DeltaNet)
nemotron-cascade2-q8|bartowski/nvidia_Nemotron-Cascade-2-30B-A3B-GGUF|nvidia_Nemotron-Cascade-2-30B-A3B-Q8_0.gguf|31|moe|Nemotron Cascade 2, Mamba-2 hybrid (replaces Nano)
# ── Coding models ─────────────────────────────────────────