179 questions
No questions match those filters.
← All questions
LLMOps & ProductionMedium· Profiling· Performance· Bottleneck Analysis
Training throughput is lower than expected. How do you...
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansTo diagnose throughput bottlenecks, use Nsight Systems to visualize the GPU timeline. If there are gaps—periods where no kernel is running—the GPU is idle, meaning the CPU is not queuing kernels fast enough (a CPU dispatch bottleneck). If the GPU is continuously running kernels but each takes too long, the bottleneck is GPU computation. In a healthy system, the CPU should run one full step ahead of the GPU to prevent idle time.