Athrael.netTag:goodput
All the articles and course lessons with the tag "goodput".
Courses
- Measuring inference (Introduction to GPU Inference)
What time to first token, time per output token, throughput and percentiles measure, and how they relate to each other.