Environment Variables for NeMo Retriever Library
The following are the environment variables that you can use to configure NeMo Retriever Library. You can specify these in a .env file in your working directory or directly as shell environment variables.
For Docker Compose .env files at the NeMo-Retriever repository root (unsupported developer tooling only), refer to docker.md.
General Environment Variables
| Name | Example | Description |
|---|---|---|
HF_ACCESS_TOKEN |
- | A token for Hugging Face Hub downloads when your runtime needs it (default Llama 3.2 chunking tokenizer is bundled in the NeMo Retriever container; a token is not required there). Refer to Token-based splitting. |
INGEST_LOG_LEVEL |
- DEBUG - INFO - WARNING - ERROR - CRITICAL |
The log level for the ingest service, which controls the verbosity of the logging output. |
NVIDIA_API_KEY |
nvapi-************* |
An authorized build.nvidia.com API key, used to interact with NVIDIA-hosted NIMs. Create through build.nvidia.com or through NGC. |
NGC_API_KEY |
— | The key that NIM microservices in the cluster use to access NGC resources. |
OTEL_EXPORTER_OTLP_ENDPOINT |
http://otel-collector:4317 |
The endpoint for the OpenTelemetry exporter, used for sending telemetry data. |