Attention and transformer training MLOps engineer at NVIDIA
Pushes changes to fast attention libraries and transformer training infrastructure, after MLOps engineering at Deutsche Post und DHL. Contributes to Dao-AILab/flash-attention, a library for exact attention, and NVIDIA/Megatron-LM, a research project for training transformer models.