LLM serving director at Together AI driving inference frameworks
Directs AI serving at Together AI, after a principal AI research role there. Contributes to sgl-project/sglang, a serving framework for large language models, and flashinfer-ai/flashinfer, a kernel library for language model serving.