Wafer

engine tuned 230 tok/s kernels fused 315 tok/s traffic re-tuned 400 tok/s “ [Wafer] has the lowest latency we’ve seen from any provider we’ve tried. And it doesn’t go off a cliff when you increase the requests per minute. ”