Echostra
Open source · Zig · In development
A from-scratch LLM inference runtime, client SDK, vector store, agent framework, and coding harness — all written in pure Zig, all speaking OpenAI-compatible protocols. Built to be genuinely competitive with Ollama and friends, not a toy.
The project is two things at once: a real product and a deep exercise in understanding how modern AI actually works at every layer, from GPU kernels to agent loops.