Examples#

New to Edge-LLM? Follow Quick Start to start a chat or launch an HTTP server, then explore the examples below.

Choose the workflow by its input and output contract. The Supported Models page maps each model family to these contracts.

Use the trtedge CLI for chat, serving, engine building, ONNX export, and model preparation.

Text Output#

Speech Output#

  • Qwen3-TTS: text, style, language, or reference speech to 24 kHz speech

  • Qwen3-Omni: text, images, or audio to text and optional 24 kHz speech

Video Output#

  • MiniMax-H3: text to video with stereo audio from the FP16 checkpoint

Action Output#

Use with other software#