Standalone Docker

Running the Standalone Docker Service

Prerequisites

• Docker

• NVIDIA Container Toolkit

Milvus

curl -sfL https://raw.githubusercontent.com/milvus-io/milvus/master/scripts/standalone_embed.sh -o standalone_embed.sh


bash standalone_embed.sh start

This will start the milvus service by default on port 19530.

If using Graph-RAG, you will need to run the following container.

Graph-RAG: Neo4J

docker run -d \
  --name neo4j \
  -p <NEO4J_PORT>:7687 \
  -e NEO4J_AUTH=<GRAPH_DB_USERNAME>/<GRAPH_DB_PASSWORD> \
  neo4j:5.26.4

Export Environment Variables

Create a .env file in the root directory and set the following variables:

MILVUS_HOST=<HOST> #milvus host, e.g. localhost
MILVUS_PORT=<MILVUS_PORT> #milvus port, e.g. 19530

GRAPH_DB_URI=bolt://<HOST>:<NEO4J_PORT> #neo4j uri, e.g. bolt://localhost:7687
GRAPH_DB_USERNAME=<GRAPH_DB_USERNAME> #neo4j username, e.g. neo4j
GRAPH_DB_PASSWORD=<GRAPH_DB_PASSWORD> #neo4j password, e.g. password

Build the vss_ctx_rag image

Make sure you are in the project root directory.

make -C docker build

Run the data ingestion service

make -C docker start_in

Run the data retrieval service

make -C docker start_ret