---
title: Full product evaluation loop
description: Define realistic scenarios for every major capability, fix failures,
  and rerun the whole evaluation set.
url: https://subramanya.ai/awesome-loops/full-product-evaluation-loop/
tags:
- evaluation
- qa
- release
---

# Full product evaluation loop

Use this to test a product as users actually experience it.

1. List realistic scenarios that cover the major capabilities.
2. Define pass/fail checks or scoring criteria before testing.
3. Run each scenario under consistent conditions.
4. Record screenshots, logs, outputs, and failure notes.
5. Fix root causes for failed scenarios.
6. Rerun affected scenarios, then rerun the full set.

Stop when the full scenario set passes against the original criteria.