← series overview
Post 8

Scar Tissue, Not Ambition

Origin story. Credibility closer.

Origin

Started with an evaluation tool. Six independent agents. Veto rule with teeth. Companies used it. That's when the real discovery happened: nobody had anything to evaluate. What they called an agent was a system prompt written in an afternoon.

So I asked what happens before evaluation. And what happens after a bad score. The platform grew backward and forward from the center. Each stage added because a real failure occurred at that exact point.

Failure → Feature

Working
Agreement
LLM-hallucinated contract was signed. Fluent. Looked legitimate. Was not. The renderer is deterministic now. Structured data in, document out. No temperature.
Veto
Rule
A brilliant, unsafe agent shipped. Scored 78 overall. Safety was 62. The total was a lie. Safety + Bias now 1.5x. Below 75, capped at 74.9.
Root Cause
Gate
Someone automated a broken process and called it transformation. Faster inefficiency is not transformation. The gate asks: fix the process first? If yes, it stops. ~20% of sessions end here.
Architecture
Agent
Teams defaulted to the platform they already used. "We use Glean" is not a platform evaluation. PRD scored against five platforms with evidence.
One HITL
Pause
Teams oscillated between zero review and five checkpoints. Zero is reckless. Five is theater. One deliberate pause, fixed point, empirical number. After gap analysis. Before workflow design.

None of this was in the original plan. I was not cutting corners. I did not know the corner was there.

Go back to that conference room from Post 1. The coffee. The pastries. The CEO on stage. "This is the year." They did not know the corners were there either.

The difference is not intelligence. The difference is having hit them. The scope is not a product roadmap. It is compiled scar tissue.

The guardrails are not a feature. The guardrails are the platform.

Why this post is last

origin stories specific failure → feature credibility loops back to post 1 scar tissue series closer