Felipe Cardoso ba24091791 feat(benchmark): add -b/--batch flag, test MoE batch size impact ...

Add batch size override to benchmark scripts. Testing -b 256 vs default
2048 on Vulkan RADV shows no meaningful difference for MoE pp2048
(826 vs 843 t/s, within noise). Community-reported +70% improvement
does not reproduce on this backend.

2026-03-30 20:01:24 +02:00

12 KiB

Raw Blame History

View Raw