Skip to main content

Build a Bundle

Start from an exact Hugging Face ID in Supported Models or a compatible local checkpoint directory:

trtmc build Qwen/Qwen3-0.6B \
--model-revision MODEL_COMMIT \
-o qwen3-0.6b.bundle

Omit --model-revision for exploration only. A reproducible result pins an immutable revision and records the complete command.

Choose one configuration source

NeedSurfaceExample
Common CLI optionDedicated flag--precision fp16
Registered feature schemaConfig file--config profile.json
One schema overrideRepeatable key/value--set namespace.field=value
Model-owned parallel buildTopology flag--tensor-parallel-size 4
trtmc build MODEL_ID \
--model-revision MODEL_COMMIT \
--precision fp16 \
--config build-profile.json \
--set qwen_vl_vision.dynamic_resolution=true \
-o model.bundle

Do not copy that combination to an arbitrary family. The selected family owns which schemas, precision modes, quantization formats, graph shapes, and topologies it supports.

Retain the build receipt

Record at least:

  • exact model ID and immutable revision;
  • output bundle name and checksum;
  • complete build command and config file;
  • build environment, TensorRT/CUDA cohort, and SM architecture;
  • family, runtime strategy, precision, quantization, and topology; and
  • whether the resulting bundle is native or platform-specialized.

Run Inspect a Bundle before inference. The CLI Reference is the source for the complete option inventory.