Skip to main content
Ctrl+K
NVIDIA NeMo Flow - Home NVIDIA NeMo Flow - Home

NVIDIA NeMo Flow

  • GitHub
NVIDIA NeMo Flow - Home NVIDIA NeMo Flow - Home

NVIDIA NeMo Flow
  • GitHub
Version v0.1 Latest stable Stable
  • v0.1 Latest stable Stable
  • v0.2 alpha.20260503 Prerelease snapshot Prerelease

Table of Contents

About NeMo Flow

  • Overview
  • Architecture
  • Ecosystem
  • Concepts
    • Scopes
    • Middleware
    • Plugins
    • Events
    • Subscribers
    • Framework Integrations
  • Release Notes
    • Highlights
    • Known Issues
    • Related Topics

Getting Started

  • Prerequisites
  • Installation
  • Configuration / Setup
  • Quick Start
    • Python Quick Start
    • Node.js Quick Start
    • Rust Quick Start

Instrument Applications

  • About
  • Basic Guide: Adding Scopes and Marks
  • Basic Guide: Instrument a Tool Call
  • Basic Guide: Instrument an LLM Call
  • Advanced Guide: Add Middleware
  • Code Examples

Integrate into Frameworks

  • About
  • Basic Guide: Adding Scopes
  • Basic Guide: Wrap Tool Calls
  • Basic Guide: Wrap LLM Calls
  • Advanced Guide: Handle Non-Serializable Data
  • Advanced Guide: Using Codecs
  • Advanced Guide: Provider Codecs
  • Advanced Guide: Provider Response Codecs
  • Code Examples

Build Plugins

  • About
  • Basic Guide: Define a Plugin
  • Basic Guide: Validate Plugin Configuration
  • Basic Guide: Register Plugin Behavior
  • Advanced Guide: Design Plugin Configuration
  • Code Examples

Export Observability Data

  • About
  • Basic Guide: Register a Subscriber
  • Advanced Guide: Export OpenTelemetry Data
  • Advanced Guide: Export OpenInference Data
  • Advanced Guide: Export ATIF
  • Code Examples

Use Adaptive Optimization

  • About
  • Basic Guide: Configure Adaptive Optimization
  • Advanced Guide: Configure Adaptive Components
  • Advanced Guide: Tune Adaptive Behavior
  • Code Examples

Contribute

  • About
  • Development Setup
  • Workflow and Reviews
  • Testing and Documentation

Reference

  • API
    • Python
      • nemo_flow
        • nemo_flow._native
        • nemo_flow.adaptive
        • nemo_flow.codecs
        • nemo_flow.guardrails
        • nemo_flow.intercepts
        • nemo_flow.llm
        • nemo_flow.plugin
        • nemo_flow.scope
        • nemo_flow.scope_local
        • nemo_flow.subscribers
        • nemo_flow.tools
        • nemo_flow.typed
    • Node.js
      • runtime
      • typed
      • plugin
      • adaptive
    • Rust
      • nemo-flow
        • mod api
        • mod codec
        • mod error
        • mod json
        • mod observability
        • mod plugin
        • mod registry
        • mod stream
      • nemo-flow-adaptive
        • mod acg
        • mod acg_component
        • mod acg_learner
        • mod acg_profile
        • mod adaptive_hints_intercept
        • mod cache_diagnostics
        • mod config
        • mod context_helpers
        • mod drain
        • mod error
        • mod intercepts
        • mod learner
        • mod plugin_component
        • mod storage
        • mod subscriber
        • mod tool_parallelism_learner
        • mod trie
        • mod types
  • Performance

Troubleshooting

  • Troubleshooting Guide

Resources

  • Support and FAQs
  • Glossary
  • Community
  • Legal
    • Open Source Software (OSS)
    • License Agreement
  • Quick Start

Quick Start#

Choose the Quick Start guide for the primary binding that you plan to use.

  • Python Quick Start
  • Node.js Quick Start
  • Rust Quick Start

previous

Configuration

next

Python Quick Start
NVIDIA NVIDIA
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © Copyright (c) 2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved..