Technology
You're shipping an AI agent that writes and edits code. Before release, design an evaluation suite that measures correctness, safety, and regression risk. Define the dataset, the scoring signals, and how you'd catch silent quality drops between model versions.
The brief
Solve it in plain text with any AI you like, in about 10 to 20 minutes. A judge scores how you reasoned, not whether you matched an answer.
01
Score distribution
Not enough scored sessions yet
The distribution appears once at least three sessions have been scored on this problem.
02
Top traces
03
Activity
No sessions in the last 30 days