cuda.bindings._v2.driver.graph_upload#

cuda.bindings._v2.driver.graph_upload(intptr_t h_graph_exec, intptr_t h_stream)#

Uploads an executable graph in a stream.

Uploads h_graph_exec to the device in h_stream without executing it. Uploads of the same h_graph_exec will be serialized. Each upload is ordered behind both any previous work in h_stream and any previous launches of h_graph_exec. Uses memory cached by stream to back the allocations owned by h_graph_exec.

Parameters:

h_graph_exec (intptr_t) – Executable graph to upload.
h_stream (intptr_t) – Stream in which to upload the graph.