Posts tagged Computation-Communication Overlap

How to Ensure Kernels Actually Overlap

While the CPU scheduler controls the kernel launch order to favor overlapping, the GPU’s Hyper-Q driver [Bradley, 2013] ultimately dictates the actual execution order. This process is inherently non-deterministic and heavily influenced by transient GPU resource occupancy.

Read more ...