The agent harness: build the loop, adopt the sandbox
The agent harness is four build-versus-adopt decisions wearing one name. Where owning the loop pays for itself, and where it quietly does not.
→ read_post() $ git log --oneline posts/ --skip=8
Field notes.
Long-ish posts about work we shipped — the decisions, the bugs, the numbers. No think-pieces, no listicles.
Durable execution for agents: replay or re-decide
Durable execution engines assume that re-running your code reproduces the same decisions. LLM agents break that assumption, and the recovery semantics you pick have real costs.
→ read_post()Chance-corrected agreement: your LLM judge is worse than your dashboard says
Raw agreement gives an LLM judge credit for guessing. Why Cohen's κ belongs on the dashboard instead, what it does not fix and how to run the position swap.
→ read_post()Your retry loop voided your conformal guarantee
Conformal prediction gives a real coverage guarantee, but it assumes exchangeability and one shot per item. Retries, drift and calibration reuse quietly break it.
→ read_post()Reading order is the document AI metric that matters
Character-level accuracy hides the failure that actually breaks document RAG. Why reading order deserves to be your headline parsing metric, and how to measure it without labels.
→ read_post()Streaming video models: the hard part is knowing when not to respond
Streaming video-language models are graded on answer accuracy, but live deployments fail on response timing, false alarms and frame budget. What to measure instead.
→ read_post()Iceberg v3 row lineage: the equality-delete trap waiting in your CDC consumer
Iceberg v3 makes row lineage mandatory, but the spec exempts rows updated via equality deletes — and that gap quietly corrupts any consumer treating _row_id as a stable key.
→ read_post()MCP servers are a supply-chain decision, not a dependency install
Third-party MCP servers put attacker-controlled text into your model context. What the disclosed incidents actually show, and the dull controls that work.
→ read_post()