Energy-Aware EAGLE-3 on 8GB: 12–17% More TPS Than SGLang Defaults
An RTX 4060 sweep that picks EAGLE-3 params per batch size, improving decode throughput by 12-17% over SGLang's automatic Llama settings while holding a 95-98% energy band.
An RTX 4060 sweep that picks EAGLE-3 params per batch size, improving decode throughput by 12-17% over SGLang's automatic Llama settings while holding a 95-98% energy band.