Local LLM runner author contributing to inference engines
Lands changes in C++ LLM inference and local model serving tools. Works on ggml-org/llama.cpp, a library for large language model inference, and ships koboldcpp, an app that runs AI models locally with a user interface.