Agent skills¶
Cosmos-Framework ships skills for coding agents such as Claude Code and Codex: step-by-step instructions to install, run, post-train and troubleshoot Cosmos3 models, and to work on this repository. Each skill is a folder with a SKILL.md file; see Agent Skills.
Load the skills¶
The skills refer to files in the repository, so work in a clone:
git clone https://github.com/NVIDIA/cosmos-framework.git
cd cosmos-framework
- Codex loads the skills in
.agents/skills/when you start it in the clone, except those in hidden folders such ascosmos3-nim-user. - Claude Code loads only the skills in
.claude/skills/, a subset of the table below. To load them while working in another project, start it withclaude --add-dir <path to the clone>. - For any skill your agent does not load, ask it to read the skill's
SKILL.md.
Agents reading this site can start from llms.txt. It links the Markdown of every page and every skill below.
Skills¶
| Skill | What it does | Folder |
|---|---|---|
| cosmos3-nim-user | Guide customers through Cosmos3 NIM deployment, endpoint verification, API example selection, hardware compatibility, and troubleshooting. | .agents/skills/cookbooks/cosmos3/nim/.agents/skills/cosmos3-nim-user/ |
| scenario-to-rds-hq | Convert a driving scenario or dataset in an unfamiliar format into RDS-HQ for WSM4 rendering, with final Hyperion camera retargeting by default. | .agents/skills/cookbooks/cosmos3/simulation/auto/wsm/skills/scenario-to-rds-hq/ |
| cosmos-automl | Optimize Cosmos Framework reasoner SFT hyperparameters or evaluation prompts with bounded AutoML. | .agents/skills/cosmos-automl/ |
| cosmos-framework-docs | Edit the Cosmos-Framework documentation and its MkDocs site. | .agents/skills/cosmos-framework-docs/ |
| cosmos3-codebase-nav | Navigate the Cosmos3 package codebase to find where parameters, configs, defaults, scripts, and documentation live. | .agents/skills/cosmos3-codebase-nav/ |
| cosmos3-env-troubleshoot | Diagnose and fix Cosmos3 environment, installation, and runtime errors. | .agents/skills/cosmos3-env-troubleshoot/ |
| cosmos3-inference | Guide users through running Cosmos3 inference — offline batch generation, online serving with Ray and Gradio, parallelism options, input formats, sampling… | .agents/skills/cosmos3-inference/ |
| cosmos3-nano-sim-auto-inference | Prepare inputs or run Cosmos3-Nano-Sim-Auto camera-only or joint camera/LiDAR generation with a released or exported student in Cosmos Framework. | .agents/skills/cosmos3-nano-sim-auto/inference/ |
| cosmos3-nano-sim-auto-post-training | Distill Cosmos3-Nano-Transfer-Auto into Cosmos3-Nano-Sim-Auto using customer RGB, WSM, captions and LiDAR in Cosmos Framework. | .agents/skills/cosmos3-nano-sim-auto/post-training/ |
| cosmos3-nano-sim-auto-troubleshooting | Diagnose Cosmos3-Nano-Sim-Auto input, causal inference, distillation, checkpoint and export failures in Cosmos Framework. | .agents/skills/cosmos3-nano-sim-auto/troubleshooting/ |
| cosmos3-nano-sim-bimanual-inference | Generate action-conditioned video with Cosmos3 Nano Sim Bimanual in Cosmos Framework. | .agents/skills/cosmos3-nano-sim-bimanual/inference/ |
| cosmos3-nano-sim-bimanual-post-training | Train Cosmos3 Nano Sim Bimanual from Cosmos3-Nano with Cosmos Framework's four native stage TOMLs and a local training bundle. | .agents/skills/cosmos3-nano-sim-bimanual/post-training/ |
| cosmos3-nano-sim-bimanual-troubleshooting | Diagnose Cosmos3 Nano Sim Bimanual setup, data, training, checkpoint, inference, and evaluation failures by locating the first broken product contract. | .agents/skills/cosmos3-nano-sim-bimanual/troubleshooting/ |
| cosmos3-nano-sim-transfer-inference | Generate RGB video with a matched Cosmos3-Nano-Sim-Transfer checkpoint. | .agents/skills/cosmos3-nano-sim-transfer/inference/ |
| cosmos3-nano-sim-transfer-post-training | Prepare aligned spatial controls, RGB targets and captions for Cosmos3-Nano-Sim-Transfer; run native Cosmos Framework Stage 0–3 training with local assets… | .agents/skills/cosmos3-nano-sim-transfer/post-training/ |
| cosmos3-nano-sim-transfer-troubleshooting | Diagnose Cosmos3-Nano-Sim-Transfer setup, checkpoint loading, media alignment, training-state and output failures in an existing workflow. | .agents/skills/cosmos3-nano-sim-transfer/troubleshooting/ |
| cosmos3-nano-transfer-auto-inference | Prepare or run Cosmos3-Nano-Transfer-Auto in Cosmos Framework on camera WSM controls and per-view captions, with optional initial RGB and joint LiDAR. | .agents/skills/cosmos3-nano-transfer-auto/inference/ |
| cosmos3-nano-transfer-auto-post-training | Fine-tune the released Cosmos3-Nano-Transfer-Auto model on paired driving data in Cosmos Framework, or run the four-phase training curriculum from Cosmos3-Nano. | .agents/skills/cosmos3-nano-transfer-auto/post-training/ |
| cosmos3-nano-transfer-auto-troubleshooting | Diagnose cosmos3-nano-transfer-auto failures, including distorted side/rear views, WSM alignment, caption mismatch, unexpected frame counts, missing LiDAR… | .agents/skills/cosmos3-nano-transfer-auto/troubleshooting/ |
| cosmos3-post-training | Guide users through Cosmos3 supervised fine-tuning (SFT) post-training: preparing the example dataset and Wan2.2 VAE, converting the base checkpoint to DCP… | .agents/skills/cosmos3-post-training/ |
| cosmos3-setup | Guide users through Cosmos3 installation, environment setup, checkpoint downloading, and verification. | .agents/skills/cosmos3-setup/ |