Local inference & serving
Running models on my own hardware — llama.cpp and vLLM on a GB10 desk-side node — and building the routing, health checks, and evaluation loops around them.
About · San Francisco
I'm Nathan — a systems engineer focused on the layer between hardware, AI models, and the people operating them. Most of what I build runs in my own lab: local inference, automation, and observability that has to actually work, because I use it daily.
How I think about the work
My background is in systems engineering and infrastructure. I care less about demos and more about the unglamorous parts that make software dependable — deployment, telemetry, failure modes, and the operator experience around all of it.
The lab on this site is a small production environment, not a mockup. Local models get served, automated agents run on real schedules, and monitoring watches nodes that fail in ordinary ways. If a system can't survive contact with my own daily use, I keep working on it.
Focus
Running models on my own hardware — llama.cpp and vLLM on a GB10 desk-side node — and building the routing, health checks, and evaluation loops around them.
Automation and agent frameworks on real schedules with real side effects: pipelines that discover, evaluate, and act — with checks and validation at each step.
Local-first observability across the lab: health monitoring, dashboards, and the operator-facing surfaces that make the rest legible.
Prototype quickly, pressure-test against real usage, and keep the interfaces clean enough to rebuild. Boring reliability is a feature.
Tooling
Elsewhere on this site
Everything referenced here is documented on this site — built, deployed, and operated by me.