Amplifying Latency and Cost of LLM Inference Via Rowhammer Attack

Large language models LLMs achieve high inference efficiency using optimized GPU kernels generated by just-in-time JIT compilation frameworks such as Triton. Triton compiles GPU kernels through an MLIR/LLVM-based pipeline. We investigate whether a Rowhammer-induced bit-flip in the CPU's DRAM can...