Skip to main content
Ctrl+K
NVIDIA NeMo Flow - Home NVIDIA NeMo Flow - Home

NVIDIA NeMo Flow

  • GitHub
NVIDIA NeMo Flow - Home NVIDIA NeMo Flow - Home

NVIDIA NeMo Flow
  • GitHub
Version v0.1 Latest stable Stable
  • v0.1 Latest stable Stable
  • v0.2 alpha.20260503 Prerelease snapshot Prerelease

Table of Contents

About NeMo Flow

  • Overview
  • Architecture
  • Ecosystem
  • Concepts
    • Scopes
    • Middleware
    • Plugins
    • Events
    • Subscribers
    • Framework Integrations
  • Release Notes
    • Highlights
    • Known Issues
    • Related Topics

Getting Started

  • Prerequisites
  • Installation
  • Configuration / Setup
  • Quick Start
    • Python Quick Start
    • Node.js Quick Start
    • Rust Quick Start

Instrument Applications

  • About
  • Basic Guide: Adding Scopes and Marks
  • Basic Guide: Instrument a Tool Call
  • Basic Guide: Instrument an LLM Call
  • Advanced Guide: Add Middleware
  • Code Examples

Integrate into Frameworks

  • About
  • Basic Guide: Adding Scopes
  • Basic Guide: Wrap Tool Calls
  • Basic Guide: Wrap LLM Calls
  • Advanced Guide: Handle Non-Serializable Data
  • Advanced Guide: Using Codecs
  • Advanced Guide: Provider Codecs
  • Advanced Guide: Provider Response Codecs
  • Code Examples

Build Plugins

  • About
  • Basic Guide: Define a Plugin
  • Basic Guide: Validate Plugin Configuration
  • Basic Guide: Register Plugin Behavior
  • Advanced Guide: Design Plugin Configuration
  • Code Examples

Export Observability Data

  • About
  • Basic Guide: Register a Subscriber
  • Advanced Guide: Export OpenTelemetry Data
  • Advanced Guide: Export OpenInference Data
  • Advanced Guide: Export ATIF
  • Code Examples

Use Adaptive Optimization

  • About
  • Basic Guide: Configure Adaptive Optimization
  • Advanced Guide: Configure Adaptive Components
  • Advanced Guide: Tune Adaptive Behavior
  • Code Examples

Contribute

  • About
  • Development Setup
  • Workflow and Reviews
  • Testing and Documentation

Reference

  • API
    • Python
      • nemo_flow
        • nemo_flow._native
        • nemo_flow.adaptive
        • nemo_flow.codecs
        • nemo_flow.guardrails
        • nemo_flow.intercepts
        • nemo_flow.llm
        • nemo_flow.plugin
        • nemo_flow.scope
        • nemo_flow.scope_local
        • nemo_flow.subscribers
        • nemo_flow.tools
        • nemo_flow.typed
    • Node.js
      • runtime
      • typed
      • plugin
      • adaptive
    • Rust
      • nemo-flow
        • mod api
        • mod codec
        • mod error
        • mod json
        • mod observability
        • mod plugin
        • mod registry
        • mod stream
      • nemo-flow-adaptive
        • mod acg
        • mod acg_component
        • mod acg_learner
        • mod acg_profile
        • mod adaptive_hints_intercept
        • mod cache_diagnostics
        • mod config
        • mod context_helpers
        • mod drain
        • mod error
        • mod intercepts
        • mod learner
        • mod plugin_component
        • mod storage
        • mod subscriber
        • mod tool_parallelism_learner
        • mod trie
        • mod types
  • Performance

Troubleshooting

  • Troubleshooting Guide

Resources

  • Support and FAQs
  • Glossary
  • Community
  • Legal
    • Open Source Software (OSS)
    • License Agreement
  • Release Notes
  • Related Topics

Related Topics#

Use these links to continue into adjacent concepts and workflows.

  • Ecosystem

  • Support and FAQs

No migration guide is required for the initial NeMo Flow release. Future public API, binding behavior, plugin configuration, or integration workflow changes should add migration guidance to the relevant release note and link it from this page.

previous

Known Issues

next

Prerequisites
NVIDIA NVIDIA
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © Copyright (c) 2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved..