nemotron_speech_streaming model family
Tasks
Supported architectures and task heads
The Hugging Face values below are copied from checkpoint metadata at the recorded revision. The TRTMC task contract comes from the exact E2E recipe. Architecture identity selects or describes a source graph; it does not imply that TRTMC reproduces every Hugging Face head with the same model_type. For example, an encoder recipe may consume the base model and intentionally return hidden states instead of the checkpoint's pretraining or classification logits.
HF model_type | HF architecture / pipeline class | TRTMC task contract | Exact recipe profiles |
|---|---|---|---|
nemotron3_5_asr | Nemotron3_5AsrForRNNTSource: config.architecturesMetadata: config.json at 1c8deaecc64b | speech_to_text | nemotron-3.5-asr-streaming-0.6b |
nemotron_asr_streaming | NemotronAsrStreamingForRNNTSource: config.architecturesMetadata: config.json at ebe59e5a8171 | speech_to_text | nemotron-speech-streaming-en-0.6bnemotron-speech-streaming-en-0.6b-tp4 |
Declared recipes
Each row comes from a model-owned E2E manifest. It declares a test recipe; it is not a live pass receipt for every hardware target.
| Recipe | Exact Hugging Face checkpoint | Task | Build configuration | Declared E2E cases | Manifest |
|---|---|---|---|---|---|
nemotron-3.5-asr-streaming-0.6b | nvidia/nemotron-3.5-asr-streaming-0.6b | fp16; single device | nemotron-3.5-asr-streaming-0.6b | tests/e2e/models/nemotron_speech_streaming/manifests/nemotron-3.5-asr-streaming-0.6b.json | |
nemotron-speech-streaming-en-0.6b | nvidia/nemotron-speech-streaming-en-0.6b | fp16; single device | nemotron-speech-streaming-en-0.6b, nemotron-speech-streaming-en-0.6b-asr-probe01, nemotron-speech-streaming-en-0.6b-asr-probe02, nemotron-speech-streaming-en-0.6b-asr-probe03, nemotron-speech-streaming-en-0.6b-asr-probe04, nemotron-speech-streaming-en-0.6b-asr-probe05, nemotron-speech-streaming-en-0.6b-asr-probe06, nemotron-speech-streaming-en-0.6b-asr-probe08 | tests/e2e/models/nemotron_speech_streaming/manifests/nemotron-speech-streaming-en-0.6b.json | |
nemotron-speech-streaming-en-0.6b-tp4 | nvidia/nemotron-speech-streaming-en-0.6b | family default; TP4 | nemotron-speech-streaming-en-0.6b-tp4 | tests/e2e/models/nemotron_speech_streaming/manifests/nemotron-speech-streaming-en-0.6b-tp4.json |
Family-owned configuration
This family does not declare a family-owned --set namespace. Use the explicit CLI options shown below and the shared configuration namespaces documented in Configure Runtime Behavior.
Family-specific CLI contracts
Inputs and options below are filtered by the declared E2E task and the methods and configuration fields used by that family's native runtime implementation. The global CLI parser accepts a wider union of flags; flags absent here are not declared for this family.
trtmc transcribe
Transcribe an audio file.
Declared recipes: nemotron-3.5-asr-streaming-0.6b, nemotron-speech-streaming-en-0.6b, nemotron-speech-streaming-en-0.6b-tp4
trtmc transcribe <bundle.bundle> --audio <input.wav> [--stream]| Supported input or option | Requirement | Runtime behavior |
|---|---|---|
--audio <PATH> | Required | Input WAV file; repeat for supported offline batches. |
--max-new-tokens <N> | Optional | Maximum output tokens. |
--stream | Optional | Use the runtime streaming transcription implementation. |
--chunk-ms <N> | Optional with --stream | Streaming audio chunk duration. |
--att-context-size <L,R> | Optional with --stream | Set left and right streaming attention context. |
--pad-and-drop-preencoded | Optional with --stream | Enable the runtime pre-encoded padding and drop path. |
--language <TAG> | Optional with --stream | Select a language from the bundle prompt dictionary. |
Code basis
Runtime provider: nemotron_speech_streaming
include/trtmc/pipeline.hsrc/cli/main.cppsrc/runtime/models/nemotron_speech_streaming/pipeline.cppsrc/runtime/models/nemotron_speech_streaming/pipeline.htests/e2e/models/nemotron_speech_streaming/manifests/nemotron-3.5-asr-streaming-0.6b.jsontests/e2e/models/nemotron_speech_streaming/manifests/nemotron-speech-streaming-en-0.6b-tp4.jsontests/e2e/models/nemotron_speech_streaming/manifests/nemotron-speech-streaming-en-0.6b.json
Bundle lifecycle commands
These commands apply to every declared recipe in this family; they do not add task inputs or model capabilities.
trtmc build
Build one exact checkpoint into a TensorRT-Model-Connect bundle.
trtmc build <hf-id> --output <bundle.bundle>trtmc inspect
Inspect bundle metadata, runtime identity, and packaged sections.
trtmc inspect <bundle.bundle>See the CLI Reference for all options and limitations.