Configuration#

NeMo Flow runtime behavior is configured through API objects and registration calls rather than a global configuration file.

Core Runtime Setup#

Most applications configure NeMo Flow by:

  1. Creating or reusing a scope stack.

  2. Registering guardrails, intercepts, or subscribers.

  3. Calling the managed tool or LLM helpers from the active scope.

  4. Deregistering global middleware that should not remain active for the lifetime of the process.

Use scope-local registration when behavior must be tied to one request, session, or agent run.

Plugin Setup#

Plugins use a structured plugin configuration with:

  • A version

  • One or more component definitions

  • Optional component policy

Start with Basic Guide: Define a Plugin when you need reusable middleware, subscribers, or adaptive behavior.

Observability Setup#

ATIF exporters, OpenTelemetry subscribers, and OpenInference subscribers are configured through their binding-native config objects. See Export Observability Data for the supported export paths.

NeMo Flow does not require application-level environment variables for normal runtime use. Configure most behavior through API objects, registration calls, or plugin configuration.

OTEL_* variables are only relevant when the underlying OpenTelemetry exporter reads endpoint settings from the environment. Prefer explicit config objects in application code so the active export settings are visible in docs, tests, and deployment manifests.

Adaptive Setup#

Adaptive optimization is enabled through the adaptive plugin component and binding helper APIs. See Configure Adaptive Optimization.