Topic
Engineering practice of optimizing GPU kernels for throughput, covering memory access, parallelism, and hardware-specific tuning.
CUDA engineers, among tech's most sought-after specialists, increasingly supervise AI that writes and tests hundreds of GPU kernels. At base salaries Nvidia advertises as high as $431,250, employers are now paying for judgement about code the engineers did not write.
Reality
PyTorch says vLLM's frontier models now ship as hardware-specific flat definitions that torch.compile cannot trace, and the new HW agnostic layers are what users on other accelerators get instead. The overhead figure came from an H100.
Reality
Google and DeepMind's method records a live search, replays thousands of exploration policies against the stored results, and sends only the winner into the next run. No weights are retrained.
Reality
Meta has open-sourced an MXFP8 forward and backward pass for FlashAttention-4 that it already runs in production ads training. The reported 1.6x forward gain over BF16 sits well under the 2-4x the block-scaled MMA instruction advertises.
Reality
Liu Shengyu, who helped write a component of DeepSeek's latest model, wrote that AI-written operators will probably be as good as his own or better. He expects to keep his job and to lose the hands-on part of it.
Reality
A JAX and Transformer Engine version of the same GB200 run reports 1,068 TFLOPS per GPU, a 10.4x gain. The 84% share bounds what fixing communication alone could have bought, so the expert matmuls got faster too.
Reality
Its August 20 bake-off priced three agents on one Nemotron port. The claim that findings transfer to the next model-chip pair is the one with no number attached.
Reality
A five-person Nvidia team published the architecture behind its AVO agent alongside a perfect public-set score. The model did not change. The system around it did.
Perspective Coverage
4 publishersReality
Sankalp placed 12th of 183 on GPU Mode's B200 QR benchmark using OpenAI Codex. The transferable part is the checker, not the ranking.
Reality