Evaluation#
Evaluation guidelines: evaluate models quickly and reliably during optimization experiments, with guidance on metrics, regression and reliability checks, and evaluation budgets.
LLM evaluation examples: benchmark frameworks, setup, and evaluation commands.
ModelOpt skills: for standardized evaluation and acceptance checks before releasing optimized models, follow the ModelOpt evaluation skill and ModelOpt results-comparison skill.