Compiler minded architect driving GPU LLM inference at NVIDIA
Builds GPU inference tooling for large language models, after compiler engineering at SiFive. Contributes to NVIDIA/TensorRT-LLM, a library for defining Large Language Models and performing inference on NVIDIA GPUs.