Skip to main content

Ctrl+K

NVIDIA NeMo Relay

GitHub

NVIDIA NeMo Relay

GitHub

Version v0.3 beta.2 Prerelease snapshot Prerelease

v0.2 Latest stable Stable
v0.1 Release snapshot Stable
v0.3 beta.2 Prerelease snapshot Prerelease

Table of Contents

About NeMo Relay

Overview
Architecture
Ecosystem
Concepts
Release Notes

Getting Started

Agent Runtime Primer
Prerequisites
Installation
Configuration / Setup
Quick Start

NeMo Relay CLI

About
Basic Usage
Claude Code
Codex
Cursor
Hermes Agent

Supported Integrations

About
OpenClaw Plugin Guide
LangChain Integration Guide
LangGraph Integration Guide
Deep Agents Integration Guide

Instrument Applications

About
Adding Scopes and Marks
Instrument a Tool Call
Instrument an LLM Call
Add Middleware
Code Examples

Observability Plugin

About
Configuration
Agent Trajectory Interchange Format (ATIF)
Agent Trajectory Observability Format (ATOF)
OpenTelemetry
OpenInference

Adaptive Plugin

About
Configuration
Adaptive Cache Governor (ACG)
Adaptive Hints

Integrate into Frameworks

About
Adding Scopes
Wrap Tool Calls
Wrap LLM Calls
Handle Non-Serializable Data
Using Codecs
Provider Codecs
Provider Response Codecs
Code Examples

Build Plugins

About
Define a Plugin
Validate Plugin Configuration
Plugin Configuration Files
Register Plugin Behavior
Design Plugin Configuration
NeMo Guardrails Example Plugin
Code Examples

Contribute

About
Development Setup
Workflow and Reviews
Testing and Documentation

Reference

APIs
Performance

Troubleshooting

Troubleshooting Guide

Resources

Support and FAQs
Glossary
Community
Legal
- Open Source Software (OSS)
- License Agreement

APIs
Rust API
Crate nemo_relay_adaptive
mod acg_profile

`mod acg_profile`#

module acg_profile#: Derives stable Adaptive Cache Governor (ACG) profile keys from structured LLM requests.

previous

mod acg_learner

next

mod adaptive_hints_intercept

Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © Copyright (c) 2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved..