CUDA Python API Reference#
Modules:
- driver
- Data types used by CUDA driver
CUuuid_stCUmemFabricHandle_stCUipcEventHandle_stCUipcMemHandle_stCUstreamBatchMemOpParams_unionCUDA_BATCH_MEM_OP_NODE_PARAMS_v1_stCUDA_BATCH_MEM_OP_NODE_PARAMS_v2_stCUasyncNotificationInfo_stCUdevprop_stCUaccessPolicyWindow_stCUDA_KERNEL_NODE_PARAMS_stCUDA_KERNEL_NODE_PARAMS_v2_stCUDA_KERNEL_NODE_PARAMS_v3_stCUDA_MEMSET_NODE_PARAMS_stCUDA_MEMSET_NODE_PARAMS_v2_stCUDA_HOST_NODE_PARAMS_stCUDA_HOST_NODE_PARAMS_v2_stCUDA_CONDITIONAL_NODE_PARAMSCUgraphEdgeData_stCUDA_GRAPH_INSTANTIATE_PARAMS_stCUlaunchMemSyncDomainMap_stCUlaunchAttributeValue_unionCUlaunchAttribute_stCUlaunchConfig_stCUexecAffinitySmCount_stCUexecAffinityParam_stCUctxCigParam_stCUctxCreateParams_stCUstreamCigParam_stCUstreamCigCaptureParams_stCUlibraryHostUniversalFunctionAndDataTable_stCUDA_MEMCPY2D_stCUDA_MEMCPY3D_stCUDA_MEMCPY3D_PEER_stCUDA_MEMCPY_NODE_PARAMS_stCUDA_ARRAY_DESCRIPTOR_stCUDA_ARRAY3D_DESCRIPTOR_stCUDA_ARRAY_SPARSE_PROPERTIES_stCUDA_ARRAY_MEMORY_REQUIREMENTS_stCUDA_RESOURCE_DESC_stCUDA_TEXTURE_DESC_stCUDA_RESOURCE_VIEW_DESC_stCUtensorMap_stCUDA_POINTER_ATTRIBUTE_P2P_TOKENS_stCUDA_LAUNCH_PARAMS_stCUDA_EXTERNAL_MEMORY_HANDLE_DESC_stCUDA_EXTERNAL_MEMORY_BUFFER_DESC_stCUDA_EXTERNAL_MEMORY_MIPMAPPED_ARRAY_DESC_stCUDA_EXTERNAL_SEMAPHORE_HANDLE_DESC_stCUDA_EXTERNAL_SEMAPHORE_SIGNAL_PARAMS_stCUDA_EXTERNAL_SEMAPHORE_WAIT_PARAMS_stCUDA_EXT_SEM_SIGNAL_NODE_PARAMS_stCUDA_EXT_SEM_SIGNAL_NODE_PARAMS_v2_stCUDA_EXT_SEM_WAIT_NODE_PARAMS_stCUDA_EXT_SEM_WAIT_NODE_PARAMS_v2_stCUarrayMapInfo_stCUmemLocation_stCUmemAllocationProp_stCUmulticastObjectProp_stCUmemAccessDesc_stCUgraphExecUpdateResultInfo_stCUmemPoolProps_stCUmemPoolPtrExportData_stCUmemcpyAttributes_stCUoffset3D_stCUextent3D_stCUmemcpy3DOperand_stCUDA_MEMCPY3D_BATCH_OP_stCUDA_MEM_ALLOC_NODE_PARAMS_v1_stCUDA_MEM_ALLOC_NODE_PARAMS_v2_stCUDA_MEM_FREE_NODE_PARAMS_stCUDA_CHILD_GRAPH_NODE_PARAMS_stCUDA_EVENT_RECORD_NODE_PARAMS_stCUDA_EVENT_WAIT_NODE_PARAMS_stCUDA_MEMCPY_BATCH_NODE_PARAMS_V1_stCUDA_FABRIC_CPY_BATCH_NODE_PARAMS_V1_stCUgraphNodeParams_stCUcheckpointCustomStoragePerDeviceData_stCUcheckpointCustomStorageInfo_stCUcheckpointLockArgs_stCUcheckpointCheckpointArgs_stCUcheckpointGpuPair_stCUcheckpointRestoreArgs_stCUcheckpointUnlockArgs_stCUeglFrame_stCUipcMem_flagsCUmemAttach_flagsCUctx_flagsCUevent_sched_flagscl_event_flagscl_context_flagsCUhostTaskSyncModeCUstream_flagsCUevent_flagsCUevent_record_flagsCUevent_wait_flagsCUatomicOperationCUatomicOperationCapabilityCUstreamWaitValue_flagsCUstreamWriteValue_flagsCUstreamBatchMemOpTypeCUstreamMemoryBarrier_flagsCUstreamAtomicReductionOpTypeCUstreamAtomicReductionDataTypeCUoccupancy_flagsCUstreamUpdateCaptureDependencies_flagsCUasyncNotificationTypeCUarray_formatCUaddress_modeCUfilter_modeCUdevice_attributeCUpointer_attributeCUfunction_attributeCUfunc_cacheCUsharedconfigCUshared_carveoutCUmemorytypeCUcomputemodeCUmem_adviseCUmem_range_attributeCUjit_optionCUjit_targetCUjit_fallbackCUjit_cacheModeCUjitInputTypeCUgraphicsRegisterFlagsCUgraphicsMapResourceFlagsCUarray_cubemap_faceCUlimitCUresourcetypeCUaccessPropertyCUgraphConditionalNodeTypeCUgraphNodeTypeCUgraphDependencyTypeCUgraphInstantiateResultCUsynchronizationPolicyCUclusterSchedulingPolicyCUlaunchMemSyncDomainCUlaunchAttributePortableClusterModeCUsharedMemoryModeCUlaunchAttributeIDCUstreamCaptureStatusCUstreamCaptureModeCUdriverProcAddress_flagsCUdriverProcAddressQueryResultCUexecAffinityTypeCUcigDataTypeCUstreamCigDataTypeCUlibraryOptionCUresultCUdevice_P2PAttributeCUresourceViewFormatCUtensorMapDataTypeCUtensorMapInterleaveCUtensorMapSwizzleCUtensorMapL2promotionCUtensorMapFloatOOBfillCUtensorMapIm2ColWideModeCUtensorMapAllocClassCUDA_POINTER_ATTRIBUTE_ACCESS_FLAGSCUexternalMemoryHandleTypeCUexternalSemaphoreHandleTypeCUmemAllocationHandleTypeCUmemAccess_flagsCUmemLocationTypeCUmemAllocationTypeCUmemAllocationGranularity_flagsCUmemRangeHandleTypeCUmemRangeFlagsCUarraySparseSubresourceTypeCUmemOperationTypeCUmemHandleTypeCUmemAllocationCompTypeCUmulticastGranularity_flagsCUgraphExecUpdateResultCUmemPool_attributeCUmemcpyFlagsCUmemcpySrcAccessOrderCUmemcpy3DOperandTypeCUgraphMem_attributeCUgraphChildGraphNodeOwnershipCUflushGPUDirectRDMAWritesOptionsCUGPUDirectRDMAWritesOrderingCUflushGPUDirectRDMAWritesScopeCUflushGPUDirectRDMAWritesTargetCUgraphDebugDot_flagsCUuserObject_flagsCUuserObjectRetain_flagsCUgraphInstantiate_flagsCUdeviceNumaConfigCUprocessStateCUeglFrameTypeCUeglResourceLocationFlagsCUeglColorFormatCUdeviceptr_v2CUdeviceptrCUdevice_v1CUdeviceCUcontextCUmoduleCUfunctionCUlibraryCUkernelCUarrayCUmipmappedArrayCUtexrefCUsurfrefCUeventCUstreamCUgraphicsResourceCUtexObject_v1CUtexObjectCUsurfObject_v1CUsurfObjectCUexternalMemoryCUexternalSemaphoreCUgraphCUgraphNodeCUgraphExecCUmemoryPoolCUuserObjectCUgraphConditionalHandleCUgraphDeviceNodeCUasyncCallbackHandleCUgreenCtxCUuuidCUmemFabricHandle_v1CUmemFabricHandleCUipcEventHandle_v1CUipcEventHandleCUipcMemHandle_v1CUipcMemHandleCUstreamBatchMemOpParams_v1CUstreamBatchMemOpParamsCUDA_BATCH_MEM_OP_NODE_PARAMS_v1CUDA_BATCH_MEM_OP_NODE_PARAMSCUDA_BATCH_MEM_OP_NODE_PARAMS_v2CUasyncNotificationInfoCUasyncCallbackCUdevprop_v1CUdevpropCUlinkStateCUhostFnCUaccessPolicyWindow_v1CUaccessPolicyWindowCUDA_KERNEL_NODE_PARAMS_v1CUDA_KERNEL_NODE_PARAMS_v2CUDA_KERNEL_NODE_PARAMSCUDA_KERNEL_NODE_PARAMS_v3CUDA_MEMSET_NODE_PARAMS_v1CUDA_MEMSET_NODE_PARAMSCUDA_MEMSET_NODE_PARAMS_v2CUDA_HOST_NODE_PARAMS_v1CUDA_HOST_NODE_PARAMSCUDA_HOST_NODE_PARAMS_v2CUDA_CONDITIONAL_NODE_PARAMSCUgraphEdgeDataCUDA_GRAPH_INSTANTIATE_PARAMSCUlaunchMemSyncDomainMapCUlaunchAttributeValueCUlaunchAttributeCUlaunchConfigCUkernelNodeAttrIDCUkernelNodeAttrValue_v1CUkernelNodeAttrValueCUstreamAttrIDCUstreamAttrValue_v1CUstreamAttrValueCUexecAffinitySmCount_v1CUexecAffinitySmCountCUexecAffinityParam_v1CUexecAffinityParamCUctxCigParamCUctxCreateParamsCUstreamCigParamCUstreamCigCaptureParamsCUlibraryHostUniversalFunctionAndDataTableCUstreamCallbackCUoccupancyB2DSizeCUDA_MEMCPY2D_v2CUDA_MEMCPY2DCUDA_MEMCPY3D_v2CUDA_MEMCPY3DCUDA_MEMCPY3D_PEER_v1CUDA_MEMCPY3D_PEERCUDA_MEMCPY_NODE_PARAMSCUDA_ARRAY_DESCRIPTOR_v2CUDA_ARRAY_DESCRIPTORCUDA_ARRAY3D_DESCRIPTOR_v2CUDA_ARRAY3D_DESCRIPTORCUDA_ARRAY_SPARSE_PROPERTIES_v1CUDA_ARRAY_SPARSE_PROPERTIESCUDA_ARRAY_MEMORY_REQUIREMENTS_v1CUDA_ARRAY_MEMORY_REQUIREMENTSCUDA_RESOURCE_DESC_v1CUDA_RESOURCE_DESCCUDA_TEXTURE_DESC_v1CUDA_TEXTURE_DESCCUDA_RESOURCE_VIEW_DESC_v1CUDA_RESOURCE_VIEW_DESCCUtensorMapCUDA_POINTER_ATTRIBUTE_P2P_TOKENS_v1CUDA_POINTER_ATTRIBUTE_P2P_TOKENSCUDA_LAUNCH_PARAMS_v1CUDA_LAUNCH_PARAMSCUDA_EXTERNAL_MEMORY_HANDLE_DESC_v1CUDA_EXTERNAL_MEMORY_HANDLE_DESCCUDA_EXTERNAL_MEMORY_BUFFER_DESC_v1CUDA_EXTERNAL_MEMORY_BUFFER_DESCCUDA_EXTERNAL_MEMORY_MIPMAPPED_ARRAY_DESC_v1CUDA_EXTERNAL_MEMORY_MIPMAPPED_ARRAY_DESCCUDA_EXTERNAL_SEMAPHORE_HANDLE_DESC_v1CUDA_EXTERNAL_SEMAPHORE_HANDLE_DESCCUDA_EXTERNAL_SEMAPHORE_SIGNAL_PARAMS_v1CUDA_EXTERNAL_SEMAPHORE_SIGNAL_PARAMSCUDA_EXTERNAL_SEMAPHORE_WAIT_PARAMS_v1CUDA_EXTERNAL_SEMAPHORE_WAIT_PARAMSCUDA_EXT_SEM_SIGNAL_NODE_PARAMS_v1CUDA_EXT_SEM_SIGNAL_NODE_PARAMSCUDA_EXT_SEM_SIGNAL_NODE_PARAMS_v2CUDA_EXT_SEM_WAIT_NODE_PARAMS_v1CUDA_EXT_SEM_WAIT_NODE_PARAMSCUDA_EXT_SEM_WAIT_NODE_PARAMS_v2CUmemGenericAllocationHandle_v1CUmemGenericAllocationHandleCUarrayMapInfo_v1CUarrayMapInfoCUmemLocation_v1CUmemLocationCUmemAllocationProp_v1CUmemAllocationPropCUmulticastObjectProp_v1CUmulticastObjectPropCUmemAccessDesc_v1CUmemAccessDescCUgraphExecUpdateResultInfo_v1CUgraphExecUpdateResultInfoCUmemPoolProps_v1CUmemPoolPropsCUmemPoolPtrExportData_v1CUmemPoolPtrExportDataCUmemcpyAttributes_v1CUmemcpyAttributesCUoffset3D_v1CUoffset3DCUextent3D_v1CUextent3DCUmemcpy3DOperand_v1CUmemcpy3DOperandCUDA_MEMCPY3D_BATCH_OP_v1CUDA_MEMCPY3D_BATCH_OPCUDA_MEM_ALLOC_NODE_PARAMS_v1CUDA_MEM_ALLOC_NODE_PARAMSCUDA_MEM_ALLOC_NODE_PARAMS_v2CUDA_MEM_FREE_NODE_PARAMSCUDA_CHILD_GRAPH_NODE_PARAMSCUDA_EVENT_RECORD_NODE_PARAMSCUDA_EVENT_WAIT_NODE_PARAMSCUDA_MEMCPY_BATCH_NODE_PARAMS_V1CUDA_MEMCPY_BATCH_NODE_PARAMSCUDA_FABRIC_COPY_BATCH_OP_v1CUDA_FABRIC_COPY_BATCH_OPCUDA_FABRIC_CPY_BATCH_NODE_PARAMS_V1CUDA_FABRIC_CPY_BATCH_NODE_PARAMSCUgraphNodeParamsCUcheckpointCustomStoragePerDeviceDataCUcheckpointOperationHandleCUcheckpointCustomStorageInfoCUcheckpointLockArgsCUcheckpointCheckpointArgsCUcheckpointGpuPairCUcheckpointRestoreArgsCUcheckpointUnlockArgsCUeglFrame_v1CUeglFrameCUeglStreamConnectiondriver.CUDA_VERSIONdriver.CU_IPC_HANDLE_SIZEdriver.CU_STREAM_LEGACYdriver.CU_STREAM_PER_THREADdriver.CU_COMPUTE_ACCELERATED_TARGET_BASEdriver.CU_COMPUTE_FAMILY_TARGET_BASEdriver.CU_GRAPH_COND_ASSIGN_DEFAULTdriver.CU_GRAPH_KERNEL_NODE_PORT_DEFAULTdriver.CU_GRAPH_KERNEL_NODE_PORT_PROGRAMMATICdriver.CU_GRAPH_KERNEL_NODE_PORT_LAUNCH_ORDERdriver.CU_KERNEL_NODE_ATTRIBUTE_ACCESS_POLICY_WINDOWdriver.CU_KERNEL_NODE_ATTRIBUTE_COOPERATIVEdriver.CU_KERNEL_NODE_ATTRIBUTE_CLUSTER_DIMENSIONdriver.CU_KERNEL_NODE_ATTRIBUTE_CLUSTER_SCHEDULING_POLICY_PREFERENCEdriver.CU_KERNEL_NODE_ATTRIBUTE_PRIORITYdriver.CU_KERNEL_NODE_ATTRIBUTE_MEM_SYNC_DOMAIN_MAPdriver.CU_KERNEL_NODE_ATTRIBUTE_MEM_SYNC_DOMAINdriver.CU_KERNEL_NODE_ATTRIBUTE_PREFERRED_CLUSTER_DIMENSIONdriver.CU_KERNEL_NODE_ATTRIBUTE_DEVICE_UPDATABLE_KERNEL_NODEdriver.CU_KERNEL_NODE_ATTRIBUTE_PREFERRED_SHARED_MEMORY_CARVEOUTdriver.CU_STREAM_ATTRIBUTE_ACCESS_POLICY_WINDOWdriver.CU_STREAM_ATTRIBUTE_SYNCHRONIZATION_POLICYdriver.CU_STREAM_ATTRIBUTE_PRIORITYdriver.CU_STREAM_ATTRIBUTE_MEM_SYNC_DOMAIN_MAPdriver.CU_STREAM_ATTRIBUTE_MEM_SYNC_DOMAINdriver.CU_MEMHOSTALLOC_PORTABLEdriver.CU_MEMHOSTALLOC_DEVICEMAPdriver.CU_MEMHOSTALLOC_WRITECOMBINEDdriver.CU_MEMHOSTREGISTER_PORTABLEdriver.CU_MEMHOSTREGISTER_DEVICEMAPdriver.CU_MEMHOSTREGISTER_IOMEMORYdriver.CU_MEMHOSTREGISTER_READ_ONLYdriver.CU_ARRAY_SPARSE_PROPERTIES_SINGLE_MIPTAILdriver.CU_TENSOR_MAP_NUM_QWORDSdriver.CUDA_EXTERNAL_MEMORY_DEDICATEDdriver.CUDA_EXTERNAL_SEMAPHORE_SIGNAL_SKIP_NVSCIBUF_MEMSYNCdriver.CUDA_EXTERNAL_SEMAPHORE_WAIT_SKIP_NVSCIBUF_MEMSYNCdriver.CUDA_NVSCISYNC_ATTR_SIGNALdriver.CUDA_NVSCISYNC_ATTR_WAITdriver.CU_MEM_CREATE_USAGE_TILE_POOLdriver.CU_MEM_CREATE_USAGE_HW_DECOMPRESSdriver.CU_MEM_CREATE_USAGE_GPU_DIRECT_RDMA_OVER_PCIEdriver.CU_MEM_POOL_CREATE_USAGE_HW_DECOMPRESSdriver.CUDA_COOPERATIVE_LAUNCH_MULTI_DEVICE_NO_PRE_LAUNCH_SYNCdriver.CUDA_COOPERATIVE_LAUNCH_MULTI_DEVICE_NO_POST_LAUNCH_SYNCdriver.CUDA_ARRAY3D_LAYEREDdriver.CUDA_ARRAY3D_2DARRAYdriver.CUDA_ARRAY3D_SURFACE_LDSTdriver.CUDA_ARRAY3D_CUBEMAPdriver.CUDA_ARRAY3D_TEXTURE_GATHERdriver.CUDA_ARRAY3D_DEPTH_TEXTUREdriver.CUDA_ARRAY3D_COLOR_ATTACHMENTdriver.CUDA_ARRAY3D_SPARSEdriver.CUDA_ARRAY3D_DEFERRED_MAPPINGdriver.CUDA_ARRAY3D_VIDEO_ENCODE_DECODEdriver.CU_TRSA_OVERRIDE_FORMATdriver.CU_TRSF_READ_AS_INTEGERdriver.CU_TRSF_NORMALIZED_COORDINATESdriver.CU_TRSF_SRGBdriver.CU_TRSF_DISABLE_TRILINEAR_OPTIMIZATIONdriver.CU_TRSF_SEAMLESS_CUBEMAPdriver.CU_LAUNCH_KERNEL_REQUIRED_BLOCK_DIMdriver.CU_LAUNCH_PARAM_END_AS_INTdriver.CU_LAUNCH_PARAM_ENDdriver.CU_LAUNCH_PARAM_BUFFER_POINTER_AS_INTdriver.CU_LAUNCH_PARAM_BUFFER_POINTERdriver.CU_LAUNCH_PARAM_BUFFER_SIZE_AS_INTdriver.CU_LAUNCH_PARAM_BUFFER_SIZEdriver.CU_PARAM_TR_DEFAULTdriver.CU_DEVICE_CPUdriver.CU_DEVICE_INVALIDdriver.MAX_PLANESdriver.CUDA_EGL_INFINITE_TIMEOUT
- Error Handling
- Initialization
- Version Management
- Device Management
cuDeviceGet()cuDeviceGetCount()cuDeviceGetName()cuDeviceGetUuid()cuDeviceGetLuid()cuDeviceTotalMem()cuDeviceGetTexture1DLinearMaxWidth()cuDeviceGetAttribute()cuDeviceGetHostAtomicCapabilities()cuDeviceGetNvSciSyncAttributes()cuDeviceSetMemPool()cuDeviceGetMemPool()cuDeviceGetDefaultMemPool()cuDeviceGetExecAffinitySupport()cuFlushGPUDirectRDMAWrites()
- Primary Context Management
- Context Management
cuCtxCreate()cuCtxDestroy()cuCtxPushCurrent()cuCtxPopCurrent()cuCtxSetCurrent()cuCtxGetCurrent()cuCtxGetDevice()cuCtxGetDevice_v2()cuCtxGetFlags()cuCtxSetFlags()cuCtxGetId()cuCtxSynchronize()cuCtxSynchronize_v2()cuCtxSetLimit()cuCtxGetLimit()cuCtxGetCacheConfig()cuCtxSetCacheConfig()cuCtxGetApiVersion()cuCtxGetStreamPriorityRange()cuCtxResetPersistingL2Cache()cuCtxGetExecAffinity()cuCtxRecordEvent()cuCtxWaitEvent()
- Module Management
CUmoduleLoadingModecuModuleLoad()cuModuleLoadData()cuModuleLoadDataEx()cuModuleLoadFatBinary()cuModuleUnload()cuModuleGetLoadingMode()cuModuleGetFunction()cuModuleGetFunctionCount()cuModuleEnumerateFunctions()cuModuleGetGlobal()cuLinkCreate()cuLinkAddData()cuLinkAddFile()cuLinkComplete()cuLinkDestroy()
- Library Management
cuLibraryLoadData()cuLibraryLoadFromFile()cuLibraryUnload()cuLibraryGetKernel()cuLibraryGetKernelCount()cuLibraryEnumerateKernels()cuLibraryGetModule()cuKernelGetFunction()cuKernelGetLibrary()cuLibraryGetGlobal()cuLibraryGetManaged()cuLibraryGetUnifiedFunction()cuKernelGetAttribute()cuKernelSetAttribute()cuKernelSetCacheConfig()cuKernelGetName()cuKernelGetParamInfo()cuKernelGetParamCount()
- Memory Management
CUmemDecompressParams_stCUmemDecompressAlgorithmCUmemDecompressParamscuMemGetInfo()cuMemAlloc()cuMemAllocPitch()cuMemFree()cuMemGetAddressRange()cuMemAllocHost()cuMemFreeHost()cuMemHostAlloc()cuMemHostGetDevicePointer()cuMemHostGetFlags()cuMemAllocManaged()cuDeviceRegisterAsyncNotification()cuDeviceUnregisterAsyncNotification()cuDeviceGetByPCIBusId()cuDeviceGetPCIBusId()cuIpcGetEventHandle()cuIpcOpenEventHandle()cuIpcGetMemHandle()cuIpcOpenMemHandle()cuIpcCloseMemHandle()cuMemHostRegister()cuMemHostUnregister()cuMemcpy()cuMemcpyPeer()cuMemcpyHtoD()cuMemcpyDtoH()cuMemcpyDtoD()cuMemcpyDtoA()cuMemcpyAtoD()cuMemcpyHtoA()cuMemcpyAtoH()cuMemcpyAtoA()cuMemcpy2D()cuMemcpy2DUnaligned()cuMemcpy3D()cuMemcpy3DPeer()cuMemcpyAsync()cuMemcpyPeerAsync()cuMemcpyHtoDAsync()cuMemcpyDtoHAsync()cuMemcpyDtoDAsync()cuMemcpyHtoAAsync()cuMemcpyAtoHAsync()cuMemcpy2DAsync()cuMemcpy3DAsync()cuMemcpy3DPeerAsync()cuMemcpyBatchAsync()cuMemcpy3DBatchAsync()cuMemcpyWithAttributesAsync()cuMemcpy3DWithAttributesAsync()cuMemsetD8()cuMemsetD16()cuMemsetD32()cuMemsetD2D8()cuMemsetD2D16()cuMemsetD2D32()cuMemsetD8Async()cuMemsetD16Async()cuMemsetD32Async()cuMemsetD2D8Async()cuMemsetD2D16Async()cuMemsetD2D32Async()cuArrayCreate()cuArrayGetDescriptor()cuArrayGetSparseProperties()cuMipmappedArrayGetSparseProperties()cuArrayGetMemoryRequirements()cuMipmappedArrayGetMemoryRequirements()cuArrayGetPlane()cuArrayDestroy()cuArray3DCreate()cuArray3DGetDescriptor()cuMipmappedArrayCreate()cuMipmappedArrayGetLevel()cuMipmappedArrayDestroy()cuMemGetHandleForAddressRange()cuMemBatchDecompressAsync()
- Virtual Memory Management
cuMemAddressReserve()cuMemAddressFree()cuMemCreate()cuMemRelease()cuMemMap()cuMemMapArrayAsync()cuMemUnmap()cuMemSetAccess()cuMemGetAccess()cuMemExportToShareableHandle()cuMemImportFromShareableHandle()cuMemGetAllocationGranularity()cuMemGetAllocationPropertiesFromHandle()cuMemRetainAllocationHandle()
- Stream Ordered Memory Allocator
cuMemFreeAsync()cuMemAllocAsync()cuMemPoolTrimTo()cuMemPoolSetAttribute()cuMemPoolGetAttribute()cuMemPoolSetAccess()cuMemPoolGetAccess()cuMemPoolCreate()cuMemPoolDestroy()cuMemGetDefaultMemPool()cuMemGetMemPool()cuMemSetMemPool()cuMemAllocFromPoolAsync()cuMemPoolExportToShareableHandle()cuMemPoolImportFromShareableHandle()cuMemPoolExportPointer()cuMemPoolImportPointer()
- Multicast Object Management
- Fabric Clique Information
- Logical Endpoint
CUlogicalEndpointFabricHandle_stCUlogicalEndpointProp_structCUlogicalEndpointIpcHandleTypeCUlogicalEndpointTypeCUlogicalEndpointFlagCUlogicalEndpointIdCUlogicalEndpointFabricHandleCUlogicalEndpointPropcuLogicalEndpointIdReserve()cuLogicalEndpointIdRelease()cuLogicalEndpointCreate()cuLogicalEndpointAddDevice()cuLogicalEndpointDestroy()cuLogicalEndpointBindAddr()cuLogicalEndpointBindMem()cuLogicalEndpointUnbind()cuLogicalEndpointExport()cuLogicalEndpointImport()cuLogicalEndpointGetLimits()cuLogicalEndpointQuery()
- Fabric Copy
- Unified Addressing
- Stream Management
CUgraphRecaptureStatusCUgraphRecaptureCallbackcuStreamCreate()cuStreamCreateWithPriority()cuStreamBeginCaptureToCig()cuStreamEndCaptureToCig()cuStreamGetPriority()cuStreamGetDevice()cuStreamGetFlags()cuStreamGetId()cuStreamGetCtx()cuStreamGetCtx_v2()cuStreamWaitEvent()cuStreamAddCallback()cuStreamBeginCapture()cuStreamBeginRecaptureToGraph()cuStreamBeginCaptureToGraph()cuThreadExchangeStreamCaptureMode()cuStreamEndCapture()cuStreamIsCapturing()cuStreamGetCaptureInfo()cuStreamUpdateCaptureDependencies()cuStreamAttachMemAsync()cuStreamQuery()cuStreamSynchronize()cuStreamDestroy()cuStreamCopyAttributes()cuStreamGetAttribute()cuStreamSetAttribute()
- Event Management
- External Resource Interoperability
- Stream Memory Operations
- Execution Control
- Graph Management
cuGraphCreate()cuGraphAddKernelNode()cuGraphKernelNodeGetParams()cuGraphKernelNodeSetParams()cuGraphAddMemcpyNode()cuGraphMemcpyNodeGetParams()cuGraphMemcpyNodeSetParams()cuGraphAddMemsetNode()cuGraphMemsetNodeGetParams()cuGraphMemsetNodeSetParams()cuGraphAddHostNode()cuGraphHostNodeGetParams()cuGraphHostNodeSetParams()cuGraphAddChildGraphNode()cuGraphChildGraphNodeGetGraph()cuGraphAddEmptyNode()cuGraphAddEventRecordNode()cuGraphEventRecordNodeGetEvent()cuGraphEventRecordNodeSetEvent()cuGraphAddEventWaitNode()cuGraphEventWaitNodeGetEvent()cuGraphEventWaitNodeSetEvent()cuGraphAddExternalSemaphoresSignalNode()cuGraphExternalSemaphoresSignalNodeGetParams()cuGraphExternalSemaphoresSignalNodeSetParams()cuGraphAddExternalSemaphoresWaitNode()cuGraphExternalSemaphoresWaitNodeGetParams()cuGraphExternalSemaphoresWaitNodeSetParams()cuGraphAddBatchMemOpNode()cuGraphBatchMemOpNodeGetParams()cuGraphBatchMemOpNodeSetParams()cuGraphExecBatchMemOpNodeSetParams()cuGraphAddMemAllocNode()cuGraphMemAllocNodeGetParams()cuGraphAddMemFreeNode()cuGraphMemFreeNodeGetParams()cuDeviceGraphMemTrim()cuDeviceGetGraphMemAttribute()cuDeviceSetGraphMemAttribute()cuGraphClone()cuGraphNodeFindInClone()cuGraphNodeGetType()cuGraphNodeGetContainingGraph()cuGraphNodeGetLocalId()cuGraphNodeGetToolsId()cuGraphGetId()cuGraphExecGetId()cuGraphGetNodes()cuGraphGetRootNodes()cuGraphGetEdges()cuGraphNodeGetDependencies()cuGraphNodeGetDependentNodes()cuGraphAddDependencies()cuGraphRemoveDependencies()cuGraphDestroyNode()cuGraphInstantiate()cuGraphInstantiateWithParams()cuGraphExecGetFlags()cuGraphExecKernelNodeSetParams()cuGraphExecMemcpyNodeSetParams()cuGraphExecMemsetNodeSetParams()cuGraphExecHostNodeSetParams()cuGraphExecChildGraphNodeSetParams()cuGraphExecEventRecordNodeSetEvent()cuGraphExecEventWaitNodeSetEvent()cuGraphExecExternalSemaphoresSignalNodeSetParams()cuGraphExecExternalSemaphoresWaitNodeSetParams()cuGraphNodeSetEnabled()cuGraphNodeGetEnabled()cuGraphUpload()cuGraphLaunch()cuGraphExecDestroy()cuGraphDestroy()cuGraphExecUpdate()cuGraphKernelNodeCopyAttributes()cuGraphKernelNodeGetAttribute()cuGraphKernelNodeSetAttribute()cuGraphDebugDotPrint()cuUserObjectCreate()cuUserObjectRetain()cuUserObjectRelease()cuGraphRetainUserObject()cuGraphReleaseUserObject()cuGraphAddNode()cuGraphAddNode_v3()cuGraphNodeSetParams()cuGraphNodeSetParams_v2()cuGraphNodeGetParams()cuGraphExecNodeSetParams()cuGraphConditionalHandleCreate()
- Occupancy
- Texture Object Management
- Surface Object Management
- Tensor Map Object Managment
- Peer Context Memory Access
- Graphics Interoperability
- Driver Entry Point Access
- Coredump Attributes Control API
CUcoredumpSettingsCUCoredumpGenerationFlagsCUcoredumpCallbackHandleCUcoredumpStatusCallbackcuCoredumpGetAttribute()cuCoredumpGetAttributeGlobal()cuCoredumpSetAttribute()cuCoredumpSetAttributeGlobal()cuCoredumpRegisterStartCallback()cuCoredumpRegisterCompleteCallback()cuCoredumpDeregisterStartCallback()cuCoredumpDeregisterCompleteCallback()
- Green Contexts
CUdevSmResource_stCUdevWorkqueueConfigResource_stCUdevWorkqueueResource_stCU_DEV_SM_RESOURCE_GROUP_PARAMS_stCUdevResource_stCUdevSmResourceCUdevWorkqueueConfigResourceCUdevWorkqueueResourceCU_DEV_SM_RESOURCE_GROUP_PARAMSCUdevResourceCUgreenCtxCreate_flagsCUdevSmResourceGroup_flagsCUdevSmResourceSplitByCount_flagsCUdevResourceTypeCUdevWorkqueueConfigScopeCUdevResourceDescCUdevSmResourceCUdevWorkqueueConfigResourceCUdevWorkqueueResourceCU_DEV_SM_RESOURCE_GROUP_PARAMScuGreenCtxCreate()cuGreenCtxDestroy()cuCtxFromGreenCtx()cuDeviceGetDevResource()cuCtxGetDevResource()cuGreenCtxGetDevResource()cuDevSmResourceSplitByCount()cuDevSmResourceSplit()cuDevResourceGenerateDesc()cuGreenCtxRecordEvent()cuGreenCtxWaitEvent()cuStreamGetGreenCtx()cuGreenCtxStreamCreate()cuGreenCtxGetId()cuStreamGetDevResource()driver.CU_DEV_SM_RESOURCE_GROUP_LOCALITY_DOMAIN_ID_ANY
- Error Log Management Functions
- CUDA Checkpointing
- Profiler Control
- EGL Interoperability
cuGraphicsEGLRegisterImage()cuEGLStreamConsumerConnect()cuEGLStreamConsumerConnectWithFlags()cuEGLStreamConsumerDisconnect()cuEGLStreamConsumerAcquireFrame()cuEGLStreamConsumerReleaseFrame()cuEGLStreamProducerConnect()cuEGLStreamProducerDisconnect()cuEGLStreamProducerPresentFrame()cuEGLStreamProducerReturnFrame()cuGraphicsResourceGetMappedEglFrame()cuEventCreateFromEGLSync()
- OpenGL Interoperability
- VDPAU Interoperability
- Data types used by CUDA driver
- driver_v2
- Data types used by CUDA driver
- Error Handling
- Initialization
- Version Management
- Device Management
- Primary Context Management
- Context Management
- Module Management
- Library Management
- Memory Management
- Virtual Memory Management
- Stream Ordered Memory Allocator
- Multicast Object Management
- Fabric Clique Information
- Logical Endpoint
- Unified Addressing
- Stream Management
- Event Management
- External Resource Interoperability
- Stream Memory Operations
- Execution Control
- Graph Management
- Occupancy
- Texture Object Management
- Surface Object Management
- Tensor Map Object Managment
- Peer Context Memory Access
- Graphics Interoperability
- Driver Entry Point Access
- Coredump Attributes Control API
- Green Contexts
- Error Log Management Functions
- CUDA Checkpointing
- Profiler Control
- EGL Interoperability
- OpenGL Interoperability
- VDPAU Interoperability
- Deprecated Context Management
- Deprecated Module Management
- Deprecated Execution Control
- Deprecated Texture Reference Management
- Deprecated Surface Reference Management
- runtime
- Data types used by CUDA Runtime
cudaChannelFormatDesccudaArraySparsePropertiescudaArrayMemoryRequirementscudaPitchedPtrcudaExtentcudaPoscudaMemcpy3DParmscudaMemcpyNodeParamscudaMemcpy3DPeerParmscudaMemsetParamscudaMemsetParamsV2cudaAccessPolicyWindowcudaHostNodeParamscudaHostNodeParamsV2cudaResourceDesccudaResourceViewDesccudaPointerAttributescudaFuncAttributescudaMemLocationcudaMemAccessDesccudaMemPoolPropscudaMemPoolPtrExportDatacudaMemAllocNodeParamscudaMemAllocNodeParamsV2cudaMemFreeNodeParamscudaMemcpyAttributescudaOffset3DcudaMemcpy3DOperandcudaMemcpy3DBatchOpCUuuid_stcudaDevicePropcudaIpcEventHandle_stcudaIpcMemHandle_stcudaMemFabricHandle_stcudaExternalMemoryHandleDesccudaExternalMemoryBufferDesccudaExternalMemoryMipmappedArrayDesccudaExternalSemaphoreHandleDesccudaExternalSemaphoreSignalParamscudaExternalSemaphoreWaitParamscudaDevSmResourcecudaDevWorkqueueConfigResourcecudaDevWorkqueueResourcecudaDevSmResourceGroupParams_stcudaDevResource_stcudalibraryHostUniversalFunctionAndDataTablecudaKernelNodeParamscudaKernelNodeParamsV2cudaExternalSemaphoreSignalNodeParamscudaExternalSemaphoreSignalNodeParamsV2cudaExternalSemaphoreWaitNodeParamscudaExternalSemaphoreWaitNodeParamsV2cudaConditionalNodeParamscudaMemcpyBatchNodeParamscudaChildGraphNodeParamscudaEventRecordNodeParamscudaEventWaitNodeParamscudaGraphNodeParamscudaGraphEdgeData_stcudaGraphInstantiateParams_stcudaGraphExecUpdateResultInfo_stcudaGraphKernelNodeUpdatecudaLaunchMemSyncDomainMap_stcudaLaunchAttributeValuecudaLaunchAttribute_stcudaAsyncNotificationInfocudaTextureDesccudaEglPlaneDesc_stcudaEglFrame_stcudaError_tcudaChannelFormatKindcudaMemoryTypecudaMemcpyKindcudaAccessPropertycudaStreamCaptureStatuscudaGraphRecaptureStatuscudaStreamCaptureModecudaSynchronizationPolicycudaClusterSchedulingPolicycudaStreamUpdateCaptureDependenciesFlagscudaUserObjectFlagscudaUserObjectRetainFlagscudaHostTaskSyncModecudaGraphicsRegisterFlagscudaGraphicsMapFlagscudaGraphicsCubeFacecudaResourceTypecudaResourceViewFormatcudaSharedMemoryModecudaFuncAttributecudaFuncCachecudaSharedMemConfigcudaSharedCarveoutcudaComputeModecudaLimitcudaMemoryAdvisecudaMemRangeAttributecudaFlushGPUDirectRDMAWritesOptionscudaGPUDirectRDMAWritesOrderingcudaFlushGPUDirectRDMAWritesScopecudaFlushGPUDirectRDMAWritesTargetcudaDeviceAttrcudaMemPoolAttrcudaMemLocationTypecudaMemAccessFlagscudaMemAllocationTypecudaMemAllocationHandleTypecudaGraphMemAttributeTypecudaMemcpyFlagscudaMemcpySrcAccessOrdercudaMemcpy3DOperandTypecudaDeviceP2PAttrcudaAtomicOperationcudaAtomicOperationCapabilitycudaExternalMemoryHandleTypecudaExternalSemaphoreHandleTypecudaDevSmResourceGroup_flagscudaDevSmResourceSplitByCount_flagscudaDevResourceTypecudaDevWorkqueueConfigScopecudaJitOptioncudaLibraryOptioncudaJit_CacheModecudaJit_FallbackcudaCGScopecudaKernelFunctionTypecudaGraphConditionalHandleFlagscudaGraphConditionalNodeTypecudaGraphNodeTypecudaGraphChildGraphNodeOwnershipcudaGraphDependencyTypecudaGraphExecUpdateResultcudaGraphInstantiateResultcudaGraphKernelNodeFieldcudaGetDriverEntryPointFlagscudaDriverEntryPointQueryResultcudaGraphDebugDotFlagscudaGraphInstantiateFlagscudaLaunchMemSyncDomaincudaLaunchAttributePortableClusterModecudaLaunchAttributeIDcudaDeviceNumaConfigcudaAsyncNotificationTypecudaLogLevelcudaFabricOpStatusSourcecudaFabricOpStatusInfocudaSurfaceBoundaryModecudaSurfaceFormatModecudaTextureAddressModecudaTextureFilterModecudaTextureReadModecudaEglFrameTypecudaEglResourceLocationFlagscudaEglColorFormatcudaDevResourceDesc_tcudaExecutionContext_tcudaArray_tcudaArray_const_tcudaMipmappedArray_tcudaMipmappedArray_const_tcudaHostFn_tCUuuidcudaUUID_tcudaIpcEventHandle_tcudaIpcMemHandle_tcudaMemFabricHandle_tcudaDevSmResourceGroupParamscudaDevResourcecudaStream_tcudaEvent_tcudaGraphicsResource_tcudaExternalMemory_tcudaExternalSemaphore_tcudaGraph_tcudaGraphNode_tcudaUserObject_tcudaGraphConditionalHandlecudaFunction_tcudaKernel_tcudaLibrary_tcudaMemPool_tcudaGraphEdgeDatacudaGraphExec_tcudaGraphInstantiateParamscudaGraphExecUpdateResultInfocudaGraphDeviceNode_tcudaLaunchMemSyncDomainMapcudaLaunchAttributeValuecudaLaunchAttributecudaAsyncCallbackHandle_tcudaAsyncNotificationInfo_tcudaAsyncCallbackcudaLogsCallbackHandlecudaLogIteratorcudaSurfaceObject_tcudaTextureObject_tcudaEglPlaneDesccudaEglFramecudaEglStreamConnectionruntime.cudaHostAllocDefaultruntime.cudaHostAllocPortableruntime.cudaHostAllocMappedruntime.cudaHostAllocWriteCombinedruntime.cudaHostRegisterDefaultruntime.cudaHostRegisterPortableruntime.cudaHostRegisterMappedruntime.cudaHostRegisterIoMemoryruntime.cudaHostRegisterReadOnlyruntime.cudaPeerAccessDefaultruntime.cudaStreamDefaultruntime.cudaStreamNonBlockingruntime.cudaStreamLegacyruntime.cudaStreamPerThreadruntime.cudaEventDefaultruntime.cudaEventBlockingSyncruntime.cudaEventDisableTimingruntime.cudaEventInterprocessruntime.cudaEventRecordDefaultruntime.cudaEventRecordExternalruntime.cudaEventWaitDefaultruntime.cudaEventWaitExternalruntime.cudaDeviceScheduleAutoruntime.cudaDeviceScheduleSpinruntime.cudaDeviceScheduleYieldruntime.cudaDeviceScheduleBlockingSyncruntime.cudaDeviceBlockingSyncruntime.cudaDeviceScheduleMaskruntime.cudaDeviceMapHostruntime.cudaDeviceLmemResizeToMaxruntime.cudaDeviceSyncMemopsruntime.cudaDeviceMaskruntime.cudaArrayDefaultruntime.cudaArrayLayeredruntime.cudaArraySurfaceLoadStoreruntime.cudaArrayCubemapruntime.cudaArrayTextureGatherruntime.cudaArrayColorAttachmentruntime.cudaArraySparseruntime.cudaArrayDeferredMappingruntime.cudaIpcMemLazyEnablePeerAccessruntime.cudaMemAttachGlobalruntime.cudaMemAttachHostruntime.cudaMemAttachSingleruntime.cudaOccupancyDefaultruntime.cudaOccupancyDisableCachingOverrideruntime.cudaCpuDeviceIdruntime.cudaInvalidDeviceIdruntime.cudaInitDeviceFlagsAreValidruntime.cudaArraySparsePropertiesSingleMipTailruntime.cudaMemPoolCreateUsageHwDecompressruntime.CUDA_IPC_HANDLE_SIZEruntime.cudaExternalMemoryDedicatedruntime.cudaExternalSemaphoreSignalSkipNvSciBufMemSyncruntime.cudaExternalSemaphoreWaitSkipNvSciBufMemSyncruntime.cudaNvSciSyncAttrSignalruntime.cudaNvSciSyncAttrWaitruntime.cudaDevSmResourceGroupLocalityDomainIdAnyruntime.cudaGraphKernelNodePortDefaultruntime.cudaGraphKernelNodePortProgrammaticruntime.cudaGraphKernelNodePortLaunchCompletionruntime.cudaStreamAttributeAccessPolicyWindowruntime.cudaStreamAttributeSynchronizationPolicyruntime.cudaStreamAttributeMemSyncDomainMapruntime.cudaStreamAttributeMemSyncDomainruntime.cudaStreamAttributePriorityruntime.cudaKernelNodeAttributeAccessPolicyWindowruntime.cudaKernelNodeAttributeCooperativeruntime.cudaKernelNodeAttributePriorityruntime.cudaKernelNodeAttributeClusterDimensionruntime.cudaKernelNodeAttributeClusterSchedulingPolicyPreferenceruntime.cudaKernelNodeAttributeMemSyncDomainMapruntime.cudaKernelNodeAttributeMemSyncDomainruntime.cudaKernelNodeAttributePreferredSharedMemoryCarveoutruntime.cudaKernelNodeAttributeDeviceUpdatableKernelNoderuntime.cudaKernelNodeAttributeNvlinkUtilCentricSchedulingruntime.cudaSurfaceType1Druntime.cudaSurfaceType2Druntime.cudaSurfaceType3Druntime.cudaSurfaceTypeCubemapruntime.cudaSurfaceType1DLayeredruntime.cudaSurfaceType2DLayeredruntime.cudaSurfaceTypeCubemapLayeredruntime.cudaTextureType1Druntime.cudaTextureType2Druntime.cudaTextureType3Druntime.cudaTextureTypeCubemapruntime.cudaTextureType1DLayeredruntime.cudaTextureType2DLayeredruntime.cudaTextureTypeCubemapLayeredruntime.CUDA_EGL_MAX_PLANES
- Device Management
cudaDeviceReset()cudaDeviceSynchronize()cudaDeviceSetLimit()cudaDeviceGetLimit()cudaDeviceGetTexture1DLinearMaxWidth()cudaDeviceGetCacheConfig()cudaDeviceGetStreamPriorityRange()cudaDeviceSetCacheConfig()cudaDeviceGetByPCIBusId()cudaDeviceGetPCIBusId()cudaIpcGetEventHandle()cudaIpcOpenEventHandle()cudaIpcGetMemHandle()cudaIpcOpenMemHandle()cudaIpcCloseMemHandle()cudaDeviceFlushGPUDirectRDMAWrites()cudaDeviceRegisterAsyncNotification()cudaDeviceUnregisterAsyncNotification()cudaGetDeviceCount()cudaGetDeviceProperties()cudaDeviceGetAttribute()cudaDeviceGetHostAtomicCapabilities()cudaDeviceGetDefaultMemPool()cudaDeviceSetMemPool()cudaDeviceGetMemPool()cudaDeviceGetNvSciSyncAttributes()cudaDeviceGetP2PAttribute()cudaDeviceGetP2PAtomicCapabilities()cudaChooseDevice()cudaInitDevice()cudaSetDevice()cudaGetDevice()cudaSetDeviceFlags()cudaGetDeviceFlags()
- Error Handling
- Stream Management
cudaGraphRecaptureCallbackDatacudaStreamCallback_tcudaGraphRecaptureCallback_tcudaStreamCreate()cudaStreamCreateWithFlags()cudaStreamCreateWithPriority()cudaStreamGetPriority()cudaStreamGetFlags()cudaStreamGetId()cudaStreamGetDevice()cudaCtxResetPersistingL2Cache()cudaStreamCopyAttributes()cudaStreamGetAttribute()cudaStreamSetAttribute()cudaStreamDestroy()cudaStreamWaitEvent()cudaStreamAddCallback()cudaStreamSynchronize()cudaStreamQuery()cudaStreamAttachMemAsync()cudaStreamBeginCapture()cudaStreamBeginRecaptureToGraph()cudaStreamBeginCaptureToGraph()cudaThreadExchangeStreamCaptureMode()cudaStreamEndCapture()cudaStreamIsCapturing()cudaStreamGetCaptureInfo()cudaStreamUpdateCaptureDependencies()
- Event Management
- External Resource Interoperability
- Execution Control
- Occupancy
- Memory Management
cudaMallocManaged()cudaMalloc()cudaMallocHost()cudaMallocPitch()cudaMallocArray()cudaFree()cudaFreeHost()cudaFreeArray()cudaFreeMipmappedArray()cudaHostAlloc()cudaHostRegister()cudaHostUnregister()cudaHostGetDevicePointer()cudaHostGetFlags()cudaMalloc3D()cudaMalloc3DArray()cudaMallocMipmappedArray()cudaGetMipmappedArrayLevel()cudaMemcpy3D()cudaMemcpy3DPeer()cudaMemcpy3DAsync()cudaMemcpy3DPeerAsync()cudaMemGetInfo()cudaArrayGetInfo()cudaArrayGetPlane()cudaArrayGetMemoryRequirements()cudaMipmappedArrayGetMemoryRequirements()cudaArrayGetSparseProperties()cudaMipmappedArrayGetSparseProperties()cudaMemcpy()cudaMemcpyPeer()cudaMemcpy2D()cudaMemcpy2DToArray()cudaMemcpy2DFromArray()cudaMemcpy2DArrayToArray()cudaMemcpyAsync()cudaMemcpyPeerAsync()cudaMemcpyBatchAsync()cudaMemcpy3DBatchAsync()cudaMemcpyWithAttributesAsync()cudaMemcpy3DWithAttributesAsync()cudaMemcpy2DAsync()cudaMemcpy2DToArrayAsync()cudaMemcpy2DFromArrayAsync()cudaMemset()cudaMemset2D()cudaMemset3D()cudaMemsetAsync()cudaMemset2DAsync()cudaMemset3DAsync()cudaMemPrefetchAsync()cudaMemPrefetchBatchAsync()cudaMemDiscardBatchAsync()cudaMemDiscardAndPrefetchBatchAsync()cudaMemGetLocationInfo()cudaMemAdvise()cudaMemRangeGetAttribute()cudaMemRangeGetAttributes()make_cudaPitchedPtr()make_cudaPos()make_cudaExtent()
- Stream Ordered Memory Allocator
cudaMallocAsync()cudaFreeAsync()cudaMemPoolTrimTo()cudaMemPoolSetAttribute()cudaMemPoolGetAttribute()cudaMemPoolSetAccess()cudaMemPoolGetAccess()cudaMemPoolCreate()cudaMemPoolDestroy()cudaMemGetDefaultMemPool()cudaMemGetMemPool()cudaMemSetMemPool()cudaMallocFromPoolAsync()cudaMemPoolExportToShareableHandle()cudaMemPoolImportFromShareableHandle()cudaMemPoolExportPointer()cudaMemPoolImportPointer()
- Unified Addressing
- Peer Device Memory Access
- OpenGL Interoperability
- Direct3D 9 Interoperability
- Direct3D 10 Interoperability
- Direct3D 11 Interoperability
- VDPAU Interoperability
- EGL Interoperability
cudaGraphicsEGLRegisterImage()cudaEGLStreamConsumerConnect()cudaEGLStreamConsumerConnectWithFlags()cudaEGLStreamConsumerDisconnect()cudaEGLStreamConsumerAcquireFrame()cudaEGLStreamConsumerReleaseFrame()cudaEGLStreamProducerConnect()cudaEGLStreamProducerDisconnect()cudaEGLStreamProducerPresentFrame()cudaEGLStreamProducerReturnFrame()cudaGraphicsResourceGetMappedEglFrame()cudaEventCreateFromEGLSync()
- Graphics Interoperability
- Texture Object Management
- Surface Object Management
- Version Management
- Error Log Management Functions
- Graph Management
cudaGraphCreate()cudaGraphAddKernelNode()cudaGraphKernelNodeGetParams()cudaGraphKernelNodeSetParams()cudaGraphKernelNodeCopyAttributes()cudaGraphKernelNodeGetAttribute()cudaGraphKernelNodeSetAttribute()cudaGraphAddMemcpyNode()cudaGraphAddMemcpyNode1D()cudaGraphMemcpyNodeGetParams()cudaGraphMemcpyNodeSetParams()cudaGraphMemcpyNodeSetParams1D()cudaGraphAddMemsetNode()cudaGraphMemsetNodeGetParams()cudaGraphMemsetNodeSetParams()cudaGraphAddHostNode()cudaGraphHostNodeGetParams()cudaGraphHostNodeSetParams()cudaGraphAddChildGraphNode()cudaGraphChildGraphNodeGetGraph()cudaGraphAddEmptyNode()cudaGraphAddEventRecordNode()cudaGraphEventRecordNodeGetEvent()cudaGraphEventRecordNodeSetEvent()cudaGraphAddEventWaitNode()cudaGraphEventWaitNodeGetEvent()cudaGraphEventWaitNodeSetEvent()cudaGraphAddExternalSemaphoresSignalNode()cudaGraphExternalSemaphoresSignalNodeGetParams()cudaGraphExternalSemaphoresSignalNodeSetParams()cudaGraphAddExternalSemaphoresWaitNode()cudaGraphExternalSemaphoresWaitNodeGetParams()cudaGraphExternalSemaphoresWaitNodeSetParams()cudaGraphAddMemAllocNode()cudaGraphMemAllocNodeGetParams()cudaGraphAddMemFreeNode()cudaGraphMemFreeNodeGetParams()cudaDeviceGraphMemTrim()cudaDeviceGetGraphMemAttribute()cudaDeviceSetGraphMemAttribute()cudaGraphClone()cudaGraphNodeFindInClone()cudaGraphNodeGetType()cudaGraphNodeGetContainingGraph()cudaGraphNodeGetLocalId()cudaGraphNodeGetToolsId()cudaGraphGetId()cudaGraphExecGetId()cudaGraphGetNodes()cudaGraphGetRootNodes()cudaGraphGetEdges()cudaGraphNodeGetDependencies()cudaGraphNodeGetDependentNodes()cudaGraphAddDependencies()cudaGraphRemoveDependencies()cudaGraphDestroyNode()cudaGraphInstantiate()cudaGraphInstantiateWithFlags()cudaGraphInstantiateWithParams()cudaGraphExecGetFlags()cudaGraphExecKernelNodeSetParams()cudaGraphExecMemcpyNodeSetParams()cudaGraphExecMemcpyNodeSetParams1D()cudaGraphExecMemsetNodeSetParams()cudaGraphExecHostNodeSetParams()cudaGraphExecChildGraphNodeSetParams()cudaGraphExecEventRecordNodeSetEvent()cudaGraphExecEventWaitNodeSetEvent()cudaGraphExecExternalSemaphoresSignalNodeSetParams()cudaGraphExecExternalSemaphoresWaitNodeSetParams()cudaGraphNodeSetEnabled()cudaGraphNodeGetEnabled()cudaGraphExecUpdate()cudaGraphUpload()cudaGraphLaunch()cudaGraphExecDestroy()cudaGraphDestroy()cudaGraphDebugDotPrint()cudaUserObjectCreate()cudaUserObjectRetain()cudaUserObjectRelease()cudaGraphRetainUserObject()cudaGraphReleaseUserObject()cudaGraphAddNode()cudaGraphNodeSetParams()cudaGraphNodeGetParams()cudaGraphExecNodeSetParams()cudaGraphConditionalHandleCreate()cudaGraphConditionalHandleCreate_v2()
- Driver Entry Point Access
- Library Management
- Execution Context Management
cudaDeviceGetDevResource()cudaDevSmResourceSplitByCount()cudaDevSmResourceSplit()cudaDevResourceGenerateDesc()cudaGreenCtxCreate()cudaExecutionCtxDestroy()cudaExecutionCtxGetDevResource()cudaExecutionCtxGetDevice()cudaExecutionCtxGetId()cudaExecutionCtxStreamCreate()cudaExecutionCtxSynchronize()cudaStreamGetDevResource()cudaExecutionCtxRecordEvent()cudaExecutionCtxWaitEvent()cudaDeviceGetExecutionCtx()
- C++ API Routines
- Interactions with the CUDA Driver API
- Profiler Control
- Data types used by CUDA Runtime
- nvrtc
- Error Handling
- General Information Query
- Compilation
nvrtcProgramnvrtcCreateProgram()nvrtcDestroyProgram()nvrtcCompileProgram()nvrtcGetPTXSize()nvrtcGetPTX()nvrtcGetCUBINSize()nvrtcGetCUBIN()nvrtcGetLTOIRSize()nvrtcGetLTOIR()nvrtcGetOptiXIRSize()nvrtcGetOptiXIR()nvrtcGetProgramLogSize()nvrtcGetProgramLog()nvrtcAddNameExpression()nvrtcGetLoweredName()nvrtcSetFlowCallback()nvrtcGetTileIRSize()nvrtcGetTileIR()
- Precompiled header (PCH) (CUDA 12.8+)
- Bundled Headers Installation
- Supported Compile Options
- nvrtc_v2
- nvjitlink
- nvvm
- nvfatbin
- cudla
- cufile
- nvml
- utils
Migration guides: