Staff Engineer building LLM agents and local inference tooling
Ships LLM agent and inference tooling, after Staff engineering at The Stepstone Group. Lands changes in Niko1221/Strata, an inference engine that runs on localhost, and contributes to ggml-org/llama.cpp, a library for LLM inference.