cuda.bindings.nvml.device_get_mps_compute_running_processes_v3#

cuda.bindings.nvml.device_get_mps_compute_running_processes_v3(intptr_t device)#

Get information about processes with a Multi-Process Service (MPS) compute context on a device.

For Volta ™️ or newer fully supported devices. This function returns information only about compute running processes (e.g. CUDA application which have active context) utilizing MPS. Any graphics applications (e.g. using OpenGL, DirectX) won’t be listed by this function. To query the current number of running compute processes, call this function with *info_count = 0. The return code will be NVML_ERROR_INSUFFICIENT_SIZE, or NVML_SUCCESS if none are running. For this call infos is allowed to be NULL. The usedGpuMemory field returned is all of the memory used by the application. Keep in mind that information returned by this call is dynamic and the number of elements might change in time. Allocate more space for infos table in case new compute processes are spawned.

Parameters:

device (intptr_t) – The device handle or MIG device handle.

Returns:

Reference in which to return the process: information.

Return type:

nvmlProcessInfo_t

Note

In MIG mode, if device handle is provided, the API returns aggregate information, only if the caller has appropriate privileges. Per-instance information can be queried by using specific MIG device handles. Querying per- instance information using MIG device handles is not supported if the device is in vGPU Host virtualization mode.