Writing

Notes on certified automation

What it takes to hand LLM judgment calls to smaller models without letting errors through.

Your 1% threshold is really 1.5%Tune a confidence threshold on a sample for a 1% error budget and it overshoots about half the time. What a real guarantee costs, in data.