Skip to main content

← All model recipe tasks

flux model family

Tasks

Supported architectures and task heads

The Hugging Face values below are copied from checkpoint metadata at the recorded revision. The TRTMC task contract comes from the exact E2E recipe. Architecture identity selects or describes a source graph; it does not imply that TRTMC reproduces every Hugging Face head with the same model_type. For example, an encoder recipe may consume the base model and intentionally return hidden states instead of the checkpoint's pretraining or classification logits.

HF model_typeHF architecture / pipeline classTRTMC task contractExact recipe profiles
Flux2Pipeline
Source: model_index._class_name
Metadata: model_index.json at 26afe3a78bb2
diffusion_media_generation
flux-2-dev
flux-2-dev-fp8
flux-2-dev-fp8-l0
flux-2-dev-fp8-l0-tp4
flux-2-dev-l0
flux-2-dev-l0-tp4
FluxPipeline
Source: model_index._class_name
Metadata: model_index.json at 741f7c3ce8b3
diffusion_media_generation
flux-schnell
flux-schnell-l0
flux-schnell-l0-batch2
flux-schnell-l0-cp4
flux-schnell-l0-tp4

Declared recipes

Each row comes from a model-owned E2E manifest. It declares a test recipe; it is not a live pass receipt for every hardware target.

RecipeExact Hugging Face checkpointTaskBuild configurationDeclared E2E casesManifest
flux-2-devblack-forest-labs/FLUX.2-devbf16; single deviceflux-2-devtests/e2e/models/flux/manifests/flux-2-dev.json
flux-2-dev-fp8black-forest-labs/FLUX.2-devfp16; single deviceflux-2-dev-fp8tests/e2e/models/flux/manifests/flux-2-dev-fp8.json
flux-2-dev-fp8-l0black-forest-labs/FLUX.2-devfp16; single deviceflux-2-dev-fp8-l0tests/e2e/models/flux/manifests/flux-2-dev-fp8-l0.json
flux-2-dev-fp8-l0-tp4black-forest-labs/FLUX.2-devfp16; TP4flux-2-dev-fp8-l0-tp4tests/e2e/models/flux/manifests/flux-2-dev-fp8-l0-tp4.json
flux-2-dev-l0black-forest-labs/FLUX.2-devbf16; single deviceflux-2-dev-l0tests/e2e/models/flux/manifests/flux-2-dev-l0.json
flux-2-dev-l0-tp4black-forest-labs/FLUX.2-devfp16; TP4flux-2-dev-l0-tp4tests/e2e/models/flux/manifests/flux-2-dev-l0-tp4.json
flux-schnellblack-forest-labs/FLUX.1-schnellfp16; single deviceflux-schnelltests/e2e/models/flux/manifests/flux-schnell.json
flux-schnell-l0black-forest-labs/FLUX.1-schnellfp16; single deviceflux-schnell-l0tests/e2e/models/flux/manifests/flux-schnell-l0.json
flux-schnell-l0-batch2black-forest-labs/FLUX.1-schnellfp16; single deviceflux-schnell-l0-batch2tests/e2e/models/flux/manifests/flux-schnell-l0-batch2.json
flux-schnell-l0-cp4black-forest-labs/FLUX.1-schnellfamily default; CP4flux-schnell-l0-cp4tests/e2e/models/flux/manifests/flux-schnell-l0-cp4.json
flux-schnell-l0-tp4black-forest-labs/FLUX.1-schnellfamily default; TP4flux-schnell-l0-tp4tests/e2e/models/flux/manifests/flux-schnell-l0-tp4.json

Family-owned configuration

This family does not declare a family-owned --set namespace. Use the explicit CLI options shown below and the shared configuration namespaces documented in Configure Runtime Behavior.

Family-specific CLI contracts

Inputs and options below are filtered by the declared E2E task and the methods and configuration fields used by that family's native runtime implementation. The global CLI parser accepts a wider union of flags; flags absent here are not declared for this family.

trtmc run

Generate an image from a text prompt.

Declared recipes: flux-2-dev, flux-2-dev-fp8, flux-2-dev-fp8-l0, flux-2-dev-fp8-l0-tp4, flux-2-dev-l0, flux-2-dev-l0-tp4, flux-schnell, flux-schnell-l0, flux-schnell-l0-batch2, flux-schnell-l0-cp4, flux-schnell-l0-tp4

trtmc run <bundle.bundle> --prompt "<text>" --output <output.png> [generation options]
Supported input or optionRequirementRuntime behavior
--prompt <TEXT>RequiredText conditioning input.
--output <PATH>OptionalOutput PNG path or directory.
--num-images <N>OptionalGenerate an image batch from one prompt.
--prompts-file <PATH>OptionalGenerate one image per line in a prompt file.
--seed <N>OptionalSet the sampling or diffusion seed.
--num-steps <N>OptionalSet the number of diffusion or flow-matching steps.
--guidance-scale <F>OptionalSet classifier-free guidance strength.
--initial-latents-raw <PATH>OptionalLoad packed float32 initial latents.
Code basis

Runtime provider: flux

  • include/trtmc/pipeline.h
  • src/cli/main.cpp
  • src/runtime/models/flux/pipeline.cpp
  • src/runtime/models/flux/pipeline.h
  • tests/e2e/models/flux/manifests/flux-2-dev-fp8-l0-tp4.json
  • tests/e2e/models/flux/manifests/flux-2-dev-fp8-l0.json
  • tests/e2e/models/flux/manifests/flux-2-dev-fp8.json
  • tests/e2e/models/flux/manifests/flux-2-dev-l0-tp4.json
  • tests/e2e/models/flux/manifests/flux-2-dev-l0.json
  • tests/e2e/models/flux/manifests/flux-2-dev.json
  • tests/e2e/models/flux/manifests/flux-schnell-l0-batch2.json
  • tests/e2e/models/flux/manifests/flux-schnell-l0-cp4.json
  • tests/e2e/models/flux/manifests/flux-schnell-l0-tp4.json
  • tests/e2e/models/flux/manifests/flux-schnell-l0.json
  • tests/e2e/models/flux/manifests/flux-schnell.json

Bundle lifecycle commands

These commands apply to every declared recipe in this family; they do not add task inputs or model capabilities.

trtmc build

Build one exact checkpoint into a TensorRT-Model-Connect bundle.

trtmc build <hf-id> --output <bundle.bundle>

trtmc inspect

Inspect bundle metadata, runtime identity, and packaged sections.

trtmc inspect <bundle.bundle>

See the CLI Reference for all options and limitations.