Operationalization
From certified agent to running program. The organizational infrastructure for deployment, adoption, maintenance, and governance.
The problem this solves
Organizations need to know how to run an AI program: who owns what, how work moves between stages, what happens when something breaks, and how to get stakeholders on board.
The operationalization layer closes that gap. It generates the documentation an organization needs to deploy, adopt, maintain, and govern the agent — using data the pipeline already collects. No new interviews, no extra data collection. One Claude API call produces four artifacts from structured pipeline data.
Working Agreement pre-engagement gate
Before any build work begins, AESOP OS generates a Working Agreement from the completed discovery session — a signed document establishing scope and commitments.
map
classification
readiness
commitments
The Working Agreement is a static markdown template with variable injection — not LLM-generated. It sits in the sidebar between Discover and Design. Design is gated behind a signed agreement, with a skip option for internal projects.
How to access it
discovery
proceed
completes
download
Data sources no new collection
Every artifact is generated from data already captured by the pipeline.
session
(Phase 5)
output
The Operationalization agent receives this structured data and produces all four artifacts in a single API call (max 16K output tokens).
The four artifacts
Matrix
- Covers 10–15 activities — discovery, design approval, KB preparation, build review, evaluation, repair, launch, training, KB maintenance, issue triage, re-evaluation, drift response, decommission.
- Rule: every activity has exactly one Accountable (A). Executive sponsor is A for GO/NO-GO, I for operations; project owner is R or A for most operational tasks.
- Rendered as: a markdown table, parsed to structured JSON for interactive rendering.
Brief
- Format: 5-minute read. Role-specific “what changes for you” scenarios, concrete asks with time commitments, thumbs-up / thumbs-down feedback.
- Tone: direct, respectful, no corporate jargon. Written for busy people who need impact, not architecture.
- Feedback loop: findings from stakeholder review paste into the Repair page, treated as real-world user-testing data alongside evaluation findings.
Plan
- Evaluation cadence tied to autonomy level — higher autonomy, more frequent evals. Includes triggers for unscheduled evaluation (score drop, KB change, process change).
- Thresholds reference certification levels — Platinum 90+, Gold 85+, Silver 80+, Bronze 75+ — and define what score drop triggers action.
- Drift monitoring: metrics to track, alert thresholds, escalation path.
Plan
- Phases: Pilot (a user subset), Expansion (a broader group with gate criteria), Full Deployment (all users, with handoff).
- Calibration: low change appetite (1–2/5) recommends a longer pilot and more hands-on support; high readiness enables faster rollout.
- Metrics: measurable adoption targets with specific measurement methods — not just “monitor usage.”
The generation pipeline
Two data sources, one agent, a single-pass fork to the four artifacts — then stakeholder feedback returns to Repair.
Session
Summary
Agent
outputs
Repair
Architecture principle: no new data collection. Every artifact is generated from structured data already captured during Discovery and Build. The Operationalization agent is a generation pass, not a new interview.