Beyond Peak Throughput: Finding and Explaining vLLM’s Concurrency Knee on an A100
A controlled saturation study tracing a reproducible throughput knee through latency, GPU profiling, and scheduler behavior.
vLLM · NVIDIA A100 · GPU profiling · Scheduler behavior
Read investigation