Distributed LLM Generation
==========================

Source https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/llm-api/llm_inference_distributed.py.

.. literalinclude:: ../../../examples/llm-api/llm_inference_distributed.py
    :language: python
    :linenos: