ML engineer pushing neighborhood attention transformers at NVIDIA
Builds sparse attention libraries for vision transformers, after research work at NVIDIA. Contributes to SHI-Labs/Neighborhood-Attention-Transformer, a library for neighborhood attention transformers, and works on SHI-Labs/NATTEN, a library for fast multi-dimensional sparse attention.