Generate a tailored evaluation framework for any AI system, then transform it into executable test scenarios.
Monolithic 4-agent pipeline. Fixed dimensions: Instructions, Ethos, Bias, Safety. Same rubric for every AI system. Great for general evaluation.
Custom rubric generated per system. Dynamic categories based on the AI's actual purpose. Tailored test scenarios that match the system's domain.
graph TD
INPUT["AI System\nInstructions"] --> PRAXIS
subgraph PraxisPhase ["PRAXIS — Rubric Generation"]
PRAXIS["PRAXIS Agent\nv1.4"] --> ANALYSIS["Instruction\nAnalysis"]
ANALYSIS --> RUBRIC["Custom Rubric\nJSON Output"]
end
RUBRIC --> THESIS
subgraph ThesisPhase ["THESIS — Scenario Generation"]
THESIS["THESIS Agent\nv1.0"] --> SCENARIOS["Evaluation Plan\nJSON Scenarios"]
end
SCENARIOS --> DECIDE{Chatbot\nEndpoint?}
DECIDE -->|Yes| EXECUTE["Execute\nScenarios"]
DECIDE -->|No| REVIEW["Review\nScenarios Only"]
EXECUTE --> RESULTS["Test\nResults"]
classDef input fill:#C64A1122,stroke:#C64A11,stroke-width:2px
classDef praxis fill:#A5650A22,stroke:#A5650A,stroke-width:1.5px
classDef thesis fill:#0E7C6622,stroke:#0E7C66,stroke-width:1.5px
classDef decision fill:#7C3AED22,stroke:#7C3AED,stroke-width:1.5px
classDef exec fill:#05966922,stroke:#059669,stroke-width:2px
class INPUT input
class PRAXIS,ANALYSIS,RUBRIC praxis
class THESIS,SCENARIOS thesis
class DECIDE decision
class EXECUTE,RESULTS,REVIEW exec