4 Turn badcases into a Dataset
Convert recurring failure patterns into reviewable Tasks without leaking raw private history.
A Dataset is curated business intent, not a dump of private transcripts. Abstract the failure, preserve the relevant constraint and create an independently reviewable expected behavior.
You do
Deduplicate failure patterns, remove private identifiers, separate tuning from holdout and review every instruction file.
Harbor records
Task ids, paths, instructions, sensitive-metadata checks and immutable source digest.
This does not prove
A clean Dataset does not prove the population is complete or that one metric captures all business risk.