cuda.bindings._v2.driver.graph_launch#

cuda.bindings._v2.driver.graph_launch(intptr_t h_graph_exec, intptr_t h_stream)#

Launches an executable graph in a stream.

Executes h_graph_exec in h_stream. Only one instance of h_graph_exec may be executing at a time. Each launch is ordered behind both any previous work in h_stream and any previous launches of h_graph_exec. To execute a graph concurrently, it must be instantiated multiple times into multiple executable graphs. If any allocations created by h_graph_exec remain unfreed (from a previous launch) and h_graph_exec was not instantiated with CUDA_GRAPH_INSTANTIATE_FLAG_AUTO_FREE_ON_LAUNCH, the launch will fail with CUDA_ERROR_INVALID_VALUE.

Parameters:

h_graph_exec (intptr_t) – Executable graph to launch.
h_stream (intptr_t) – Stream in which to launch the graph.