Staff engineer behind LLM serving optimizations at humans&
Ships LLM serving and inference optimizations, after software engineering at Google. Works on sgl-project/sglang, a serving framework for large language models, and flashinfer-ai/flashinfer, a kernel library for LLM serving.