CEO cutting LLM inference costs through open source at Inferact
Leads inference cost reduction at Inferact, with a Member of Technical Staff background from Character.AI. Works on vllm-project/vllm, a serving engine for LLMs, and ucbrise/clipper, a prediction-serving system.




