← All questions
LLMOps & ProductionEasy· CUDA· Benchmarking· Debugging

A colleague benchmarks their kernel and claims it is 50...

The most likely explanation is that the colleague failed to use cuda.synchronize(). Without synchronization, the CPU timer measures only the time taken to queue the CUDA command, which is typically 10-100 μs, rather than the actual GPU execution time, which could be 50+ ms. This leads to a massive, inaccurate inflation of the reported speedup.

Code playground (Python)