SimReady Benchmark

This guide covers benchmarking with simready-benchmark. It explains how to plan benchmarks, run them in the engine, stamp results on the asset, and read reports. For concepts, test families, and how benchmarking relates to schema validation, start with Overview in the table of contents below.

Read the pages below in order, or jump to Running Tests if you are already set up.

• Overview
  • The Tool and the Tests
  • Test Families
  • Relationship to Features and Profiles
  • Next Steps
• Pipeline and Stages
  • Plan
  • Run
  • Stamp
  • Report
  • Next Steps
• Running Tests
  • Prerequisites
  • Install
  • Configure the Engine
  • Run
  • Next Steps
• Reading Reports
  • Output Layout
  • Outcomes and Exit Codes
  • Verify a Clean Pass
  • The Runtime Stamp
  • Related Pages
• Tests Reference
  • What the Framework Does
  • How to Read a Test Result
  • Test Families

For verifying a simready-benchmark release, the command-line QA test plan (every command, exit-code gating, and the list-tests against plan against report consistency gate) lives in the simready-explorer repository at docs/qa-cli-test-plan.md.