C++ developer running LLMs locally on the metal
Pushes C/C++ inference engines for running AI models locally in Sydney. Contributes to ggml-org/llama.cpp, a library for LLM inference in C/C++, and LostRuins/koboldcpp, an app for running GGUF AI models locally.