Skip to main content
Ctrl+K
Warning: This documentation is only a preview for PR 1776!
cuda.bindings - Home cuda.bindings - Home

cuda.bindings

  • Release Notes
  • Installation
  • Overview
  • Motivation
  • Environment Variables
    • CUDA Python API Reference
    • Tips and Tricks
    • cuda.bindings Support Policy
    • Contributing
    • Code of Conduct
    • Software License Agreement
cuda.bindings - Home cuda.bindings - Home

cuda.bindings

  • Release Notes
  • Installation
  • Overview
  • Motivation
  • Environment Variables
  • CUDA Python API Reference
  • Tips and Tricks
  • cuda.bindings Support Policy
  • Contributing
  • Code of Conduct
  • Software License Agreement

Table of Contents

Contents:

  • Release Notes
    • 13.2.0
    • 13.1.1
    • 13.1.0
    • 13.0.3
    • 13.0.2
    • 13.0.1
    • 13.0.0
    • 12.9.6
    • 12.9.5
    • 12.9.4
    • 12.9.3
    • 12.9.2
    • 12.9.1
    • 12.9.0
    • 12.8.0
    • 12.6.2
    • 12.6.1
    • 12.6.0
    • 12.5.0
    • 12.4.0
    • 12.3.0
    • 12.2.1
    • 12.2.0
    • 12.1.0
    • 12.0.0
    • 11.8.7
    • 11.8.6
    • 11.8.5
    • 11.8.4
    • 11.8.3
    • 11.8.2
    • 11.8.1
    • 11.8.0
    • 11.7.1
    • 11.7.0
    • 11.6.1
    • 11.6.0
    • 11.5.0
    • 11.4.0
  • Installation
  • Overview
  • Motivation
  • Environment Variables
  • CUDA Python API Reference
    • driver
    • runtime
    • nvrtc
    • nvjitlink
    • nvvm
    • nvfatbin
    • cufile
      • cuda.bindings.cufile.handle_register
      • cuda.bindings.cufile.handle_deregister
      • cuda.bindings.cufile.buf_register
      • cuda.bindings.cufile.buf_deregister
      • cuda.bindings.cufile.read
      • cuda.bindings.cufile.write
      • cuda.bindings.cufile.driver_open
      • cuda.bindings.cufile.use_count
      • cuda.bindings.cufile.driver_get_properties
      • cuda.bindings.cufile.driver_set_poll_mode
      • cuda.bindings.cufile.driver_set_max_direct_io_size
      • cuda.bindings.cufile.driver_set_max_cache_size
      • cuda.bindings.cufile.driver_set_max_pinned_mem_size
      • cuda.bindings.cufile.batch_io_set_up
      • cuda.bindings.cufile.batch_io_submit
      • cuda.bindings.cufile.batch_io_get_status
      • cuda.bindings.cufile.batch_io_cancel
      • cuda.bindings.cufile.batch_io_destroy
      • cuda.bindings.cufile.read_async
      • cuda.bindings.cufile.write_async
      • cuda.bindings.cufile.stream_register
      • cuda.bindings.cufile.stream_deregister
      • cuda.bindings.cufile.get_version
      • cuda.bindings.cufile.get_parameter_size_t
      • cuda.bindings.cufile.get_parameter_bool
      • cuda.bindings.cufile.get_parameter_string
      • cuda.bindings.cufile.set_parameter_size_t
      • cuda.bindings.cufile.set_parameter_bool
      • cuda.bindings.cufile.set_parameter_string
      • cuda.bindings.cufile.op_status_error
      • cuda.bindings.cufile.driver_close
      • cuda.bindings.cufile.IOEvents
      • cuda.bindings.cufile.Descr
      • cuda.bindings.cufile.IOParams
      • cuda.bindings.cufile.OpError
      • cuda.bindings.cufile.DriverStatusFlags
      • cuda.bindings.cufile.DriverControlFlags
      • cuda.bindings.cufile.FeatureFlags
      • cuda.bindings.cufile.FileHandleType
      • cuda.bindings.cufile.Opcode
      • cuda.bindings.cufile.Status
      • cuda.bindings.cufile.BatchMode
      • cuda.bindings.cufile.SizeTConfigParameter
      • cuda.bindings.cufile.BoolConfigParameter
      • cuda.bindings.cufile.StringConfigParameter
      • cuda.bindings.cufile.cuFileError
    • nvml
      • cuda.bindings.nvml.compute_instance_destroy
      • cuda.bindings.nvml.compute_instance_get_info_v2
      • cuda.bindings.nvml.device_clear_accounting_pids
      • cuda.bindings.nvml.device_clear_cpu_affinity
      • cuda.bindings.nvml.device_clear_ecc_error_counts
      • cuda.bindings.nvml.device_clear_field_values
      • cuda.bindings.nvml.device_create_gpu_instance
      • cuda.bindings.nvml.device_create_gpu_instance_with_placement
      • cuda.bindings.nvml.device_discover_gpus
      • cuda.bindings.nvml.device_get_accounting_buffer_size
      • cuda.bindings.nvml.device_get_accounting_mode
      • cuda.bindings.nvml.device_get_accounting_pids
      • cuda.bindings.nvml.device_get_accounting_stats
      • cuda.bindings.nvml.device_get_active_vgpus
      • cuda.bindings.nvml.device_get_adaptive_clock_info_status
      • cuda.bindings.nvml.device_get_addressing_mode
      • cuda.bindings.nvml.device_get_api_restriction
      • cuda.bindings.nvml.device_get_architecture
      • cuda.bindings.nvml.device_get_attributes_v2
      • cuda.bindings.nvml.device_get_auto_boosted_clocks_enabled
      • cuda.bindings.nvml.device_get_bar1_memory_info
      • cuda.bindings.nvml.device_get_board_id
      • cuda.bindings.nvml.device_get_board_part_number
      • cuda.bindings.nvml.device_get_brand
      • cuda.bindings.nvml.device_get_bridge_chip_info
      • cuda.bindings.nvml.device_get_bus_type
      • cuda.bindings.nvml.device_get_c2c_mode_info_v
      • cuda.bindings.nvml.device_get_capabilities
      • cuda.bindings.nvml.device_get_clk_mon_status
      • cuda.bindings.nvml.device_get_clock
      • cuda.bindings.nvml.device_get_clock_info
      • cuda.bindings.nvml.device_get_clock_offsets
      • cuda.bindings.nvml.device_get_compute_instance_id
      • cuda.bindings.nvml.device_get_compute_mode
      • cuda.bindings.nvml.device_get_compute_running_processes_v3
      • cuda.bindings.nvml.device_get_conf_compute_gpu_attestation_report
      • cuda.bindings.nvml.device_get_conf_compute_gpu_certificate
      • cuda.bindings.nvml.device_get_conf_compute_mem_size_info
      • cuda.bindings.nvml.device_get_conf_compute_protected_memory_usage
      • cuda.bindings.nvml.device_get_cooler_info
      • cuda.bindings.nvml.device_get_count_v2
      • cuda.bindings.nvml.device_get_cpu_affinity
      • cuda.bindings.nvml.device_get_cpu_affinity_within_scope
      • cuda.bindings.nvml.device_get_creatable_vgpus
      • cuda.bindings.nvml.device_get_cuda_compute_capability
      • cuda.bindings.nvml.device_get_curr_pcie_link_generation
      • cuda.bindings.nvml.device_get_curr_pcie_link_width
      • cuda.bindings.nvml.device_get_current_clock_freqs
      • cuda.bindings.nvml.device_get_current_clocks_event_reasons
      • cuda.bindings.nvml.device_get_decoder_utilization
      • cuda.bindings.nvml.device_get_default_ecc_mode
      • cuda.bindings.nvml.device_get_device_handle_from_mig_device_handle
      • cuda.bindings.nvml.device_get_display_active
      • cuda.bindings.nvml.device_get_display_mode
      • cuda.bindings.nvml.device_get_dram_encryption_mode
      • cuda.bindings.nvml.device_get_driver_model_v2
      • cuda.bindings.nvml.device_get_dynamic_pstates_info
      • cuda.bindings.nvml.device_get_ecc_mode
      • cuda.bindings.nvml.device_get_encoder_capacity
      • cuda.bindings.nvml.device_get_encoder_sessions
      • cuda.bindings.nvml.device_get_encoder_stats
      • cuda.bindings.nvml.device_get_encoder_utilization
      • cuda.bindings.nvml.device_get_enforced_power_limit
      • cuda.bindings.nvml.device_get_fan_control_policy_v2
      • cuda.bindings.nvml.device_get_fan_speed
      • cuda.bindings.nvml.device_get_fan_speed_rpm
      • cuda.bindings.nvml.device_get_fan_speed_v2
      • cuda.bindings.nvml.device_get_fbc_sessions
      • cuda.bindings.nvml.device_get_fbc_stats
      • cuda.bindings.nvml.device_get_field_values
      • cuda.bindings.nvml.device_get_gpc_clk_min_max_vf_offset
      • cuda.bindings.nvml.device_get_gpc_clk_vf_offset
      • cuda.bindings.nvml.device_get_gpu_fabric_info_v
      • cuda.bindings.nvml.device_get_gpu_instance_by_id
      • cuda.bindings.nvml.device_get_gpu_instance_id
      • cuda.bindings.nvml.device_get_gpu_instance_possible_placements_v2
      • cuda.bindings.nvml.device_get_gpu_instance_profile_info_by_id_v
      • cuda.bindings.nvml.device_get_gpu_instance_profile_info_v
      • cuda.bindings.nvml.device_get_gpu_instance_remaining_capacity
      • cuda.bindings.nvml.device_get_gpu_instances
      • cuda.bindings.nvml.device_get_gpu_max_pcie_link_generation
      • cuda.bindings.nvml.device_get_gpu_operation_mode
      • cuda.bindings.nvml.device_get_grid_licensable_features_v4
      • cuda.bindings.nvml.device_get_gsp_firmware_mode
      • cuda.bindings.nvml.device_get_gsp_firmware_version
      • cuda.bindings.nvml.device_get_handle_by_index_v2
      • cuda.bindings.nvml.device_get_handle_by_pci_bus_id_v2
      • cuda.bindings.nvml.device_get_handle_by_serial
      • cuda.bindings.nvml.device_get_handle_by_uuid
      • cuda.bindings.nvml.device_get_handle_by_uuidv
      • cuda.bindings.nvml.device_get_host_vgpu_mode
      • cuda.bindings.nvml.device_get_hostname_v1
      • cuda.bindings.nvml.device_get_index
      • cuda.bindings.nvml.device_get_inforom_configuration_checksum
      • cuda.bindings.nvml.device_get_inforom_image_version
      • cuda.bindings.nvml.device_get_inforom_version
      • cuda.bindings.nvml.device_get_irq_num
      • cuda.bindings.nvml.device_get_jpg_utilization
      • cuda.bindings.nvml.device_get_last_bbx_flush_time
      • cuda.bindings.nvml.device_get_margin_temperature
      • cuda.bindings.nvml.device_get_max_clock_info
      • cuda.bindings.nvml.device_get_max_customer_boost_clock
      • cuda.bindings.nvml.device_get_max_mig_device_count
      • cuda.bindings.nvml.device_get_max_pcie_link_generation
      • cuda.bindings.nvml.device_get_max_pcie_link_width
      • cuda.bindings.nvml.device_get_mem_clk_min_max_vf_offset
      • cuda.bindings.nvml.device_get_mem_clk_vf_offset
      • cuda.bindings.nvml.device_get_memory_affinity
      • cuda.bindings.nvml.device_get_memory_bus_width
      • cuda.bindings.nvml.device_get_memory_error_counter
      • cuda.bindings.nvml.device_get_memory_info_v2
      • cuda.bindings.nvml.device_get_mig_device_handle_by_index
      • cuda.bindings.nvml.device_get_mig_mode
      • cuda.bindings.nvml.device_get_min_max_clock_of_p_state
      • cuda.bindings.nvml.device_get_min_max_fan_speed
      • cuda.bindings.nvml.device_get_minor_number
      • cuda.bindings.nvml.device_get_module_id
      • cuda.bindings.nvml.device_get_mps_compute_running_processes_v3
      • cuda.bindings.nvml.device_get_multi_gpu_board
      • cuda.bindings.nvml.device_get_name
      • cuda.bindings.nvml.device_get_num_fans
      • cuda.bindings.nvml.device_get_num_gpu_cores
      • cuda.bindings.nvml.device_get_numa_node_id
      • cuda.bindings.nvml.device_get_nvlink_bw_mode
      • cuda.bindings.nvml.device_get_nvlink_capability
      • cuda.bindings.nvml.device_get_nvlink_error_counter
      • cuda.bindings.nvml.device_get_nvlink_info
      • cuda.bindings.nvml.device_get_nvlink_remote_device_type
      • cuda.bindings.nvml.device_get_nvlink_remote_pci_info_v2
      • cuda.bindings.nvml.device_get_nvlink_state
      • cuda.bindings.nvml.device_get_nvlink_supported_bw_modes
      • cuda.bindings.nvml.device_get_nvlink_version
      • cuda.bindings.nvml.device_get_ofa_utilization
      • cuda.bindings.nvml.device_get_p2p_status
      • cuda.bindings.nvml.device_get_pci_info_ext
      • cuda.bindings.nvml.device_get_pci_info_v3
      • cuda.bindings.nvml.device_get_pcie_link_max_speed
      • cuda.bindings.nvml.device_get_pcie_replay_counter
      • cuda.bindings.nvml.device_get_pcie_speed
      • cuda.bindings.nvml.device_get_pcie_throughput
      • cuda.bindings.nvml.device_get_pdi
      • cuda.bindings.nvml.device_get_performance_modes
      • cuda.bindings.nvml.device_get_performance_state
      • cuda.bindings.nvml.device_get_persistence_mode
      • cuda.bindings.nvml.device_get_pgpu_metadata_string
      • cuda.bindings.nvml.device_get_platform_info
      • cuda.bindings.nvml.device_get_power_management_default_limit
      • cuda.bindings.nvml.device_get_power_management_limit
      • cuda.bindings.nvml.device_get_power_management_limit_constraints
      • cuda.bindings.nvml.device_get_power_mizer_mode_v1
      • cuda.bindings.nvml.device_get_power_source
      • cuda.bindings.nvml.device_get_power_state
      • cuda.bindings.nvml.device_get_power_usage
      • cuda.bindings.nvml.device_get_process_utilization
      • cuda.bindings.nvml.device_get_processes_utilization_info
      • cuda.bindings.nvml.device_get_remapped_rows
      • cuda.bindings.nvml.device_get_repair_status
      • cuda.bindings.nvml.device_get_retired_pages
      • cuda.bindings.nvml.device_get_retired_pages_pending_status
      • cuda.bindings.nvml.device_get_retired_pages_v2
      • cuda.bindings.nvml.device_get_row_remapper_histogram
      • cuda.bindings.nvml.device_get_running_process_detail_list
      • cuda.bindings.nvml.device_get_samples
      • cuda.bindings.nvml.device_get_serial
      • cuda.bindings.nvml.device_get_sram_ecc_error_status
      • cuda.bindings.nvml.device_get_sram_unique_uncorrected_ecc_error_counts
      • cuda.bindings.nvml.device_get_supported_clocks_event_reasons
      • cuda.bindings.nvml.device_get_supported_event_types
      • cuda.bindings.nvml.device_get_supported_graphics_clocks
      • cuda.bindings.nvml.device_get_supported_memory_clocks
      • cuda.bindings.nvml.device_get_supported_performance_states
      • cuda.bindings.nvml.device_get_supported_vgpus
      • cuda.bindings.nvml.device_get_target_fan_speed
      • cuda.bindings.nvml.device_get_temperature_threshold
      • cuda.bindings.nvml.device_get_temperature_v
      • cuda.bindings.nvml.device_get_thermal_settings
      • cuda.bindings.nvml.device_get_topology_common_ancestor
      • cuda.bindings.nvml.device_get_topology_nearest_gpus
      • cuda.bindings.nvml.device_get_total_ecc_errors
      • cuda.bindings.nvml.device_get_total_energy_consumption
      • cuda.bindings.nvml.device_get_unrepairable_memory_flag_v1
      • cuda.bindings.nvml.device_get_utilization_rates
      • cuda.bindings.nvml.device_get_uuid
      • cuda.bindings.nvml.device_get_vbios_version
      • cuda.bindings.nvml.device_get_vgpu_capabilities
      • cuda.bindings.nvml.device_get_vgpu_heterogeneous_mode
      • cuda.bindings.nvml.device_get_vgpu_instances_utilization_info
      • cuda.bindings.nvml.device_get_vgpu_metadata
      • cuda.bindings.nvml.device_get_vgpu_process_utilization
      • cuda.bindings.nvml.device_get_vgpu_processes_utilization_info
      • cuda.bindings.nvml.device_get_vgpu_scheduler_capabilities
      • cuda.bindings.nvml.device_get_vgpu_scheduler_log
      • cuda.bindings.nvml.device_get_vgpu_scheduler_state
      • cuda.bindings.nvml.device_get_vgpu_type_creatable_placements
      • cuda.bindings.nvml.device_get_vgpu_type_supported_placements
      • cuda.bindings.nvml.device_get_vgpu_utilization
      • cuda.bindings.nvml.device_get_virtualization_mode
      • cuda.bindings.nvml.device_is_mig_device_handle
      • cuda.bindings.nvml.device_modify_drain_state
      • cuda.bindings.nvml.device_on_same_board
      • cuda.bindings.nvml.device_power_smoothing_activate_preset_profile
      • cuda.bindings.nvml.device_power_smoothing_set_state
      • cuda.bindings.nvml.device_power_smoothing_update_preset_profile_param
      • cuda.bindings.nvml.device_query_drain_state
      • cuda.bindings.nvml.device_read_prm_counters_v1
      • cuda.bindings.nvml.device_read_write_prm_v1
      • cuda.bindings.nvml.device_register_events
      • cuda.bindings.nvml.device_remove_gpu_v2
      • cuda.bindings.nvml.device_reset_gpu_locked_clocks
      • cuda.bindings.nvml.device_reset_memory_locked_clocks
      • cuda.bindings.nvml.device_reset_nvlink_error_counters
      • cuda.bindings.nvml.device_set_accounting_mode
      • cuda.bindings.nvml.device_set_api_restriction
      • cuda.bindings.nvml.device_set_auto_boosted_clocks_enabled
      • cuda.bindings.nvml.device_set_clock_offsets
      • cuda.bindings.nvml.device_set_compute_mode
      • cuda.bindings.nvml.device_set_conf_compute_unprotected_mem_size
      • cuda.bindings.nvml.device_set_cpu_affinity
      • cuda.bindings.nvml.device_set_default_auto_boosted_clocks_enabled
      • cuda.bindings.nvml.device_set_default_fan_speed_v2
      • cuda.bindings.nvml.device_set_dram_encryption_mode
      • cuda.bindings.nvml.device_set_driver_model
      • cuda.bindings.nvml.device_set_ecc_mode
      • cuda.bindings.nvml.device_set_fan_control_policy
      • cuda.bindings.nvml.device_set_fan_speed_v2
      • cuda.bindings.nvml.device_set_gpu_locked_clocks
      • cuda.bindings.nvml.device_set_gpu_operation_mode
      • cuda.bindings.nvml.device_set_hostname_v1
      • cuda.bindings.nvml.device_set_memory_locked_clocks
      • cuda.bindings.nvml.device_set_mig_mode
      • cuda.bindings.nvml.device_set_nvlink_bw_mode
      • cuda.bindings.nvml.device_set_nvlink_device_low_power_threshold
      • cuda.bindings.nvml.device_set_persistence_mode
      • cuda.bindings.nvml.device_set_power_management_limit_v2
      • cuda.bindings.nvml.device_set_power_mizer_mode_v1
      • cuda.bindings.nvml.device_set_rusd_settings_v1
      • cuda.bindings.nvml.device_set_temperature_threshold
      • cuda.bindings.nvml.device_set_vgpu_capabilities
      • cuda.bindings.nvml.device_set_vgpu_heterogeneous_mode
      • cuda.bindings.nvml.device_set_vgpu_scheduler_state
      • cuda.bindings.nvml.device_set_virtualization_mode
      • cuda.bindings.nvml.device_validate_inforom
      • cuda.bindings.nvml.error_string
      • cuda.bindings.nvml.event_set_create
      • cuda.bindings.nvml.event_set_free
      • cuda.bindings.nvml.event_set_wait_v2
      • cuda.bindings.nvml.get_excluded_device_count
      • cuda.bindings.nvml.get_excluded_device_info_by_index
      • cuda.bindings.nvml.get_vgpu_compatibility
      • cuda.bindings.nvml.get_vgpu_driver_capabilities
      • cuda.bindings.nvml.get_vgpu_version
      • cuda.bindings.nvml.gpu_instance_create_compute_instance
      • cuda.bindings.nvml.gpu_instance_create_compute_instance_with_placement
      • cuda.bindings.nvml.gpu_instance_destroy
      • cuda.bindings.nvml.gpu_instance_get_active_vgpus
      • cuda.bindings.nvml.gpu_instance_get_compute_instance_by_id
      • cuda.bindings.nvml.gpu_instance_get_compute_instance_possible_placements
      • cuda.bindings.nvml.gpu_instance_get_compute_instance_profile_info_v
      • cuda.bindings.nvml.gpu_instance_get_compute_instance_remaining_capacity
      • cuda.bindings.nvml.gpu_instance_get_compute_instances
      • cuda.bindings.nvml.gpu_instance_get_creatable_vgpus
      • cuda.bindings.nvml.gpu_instance_get_info
      • cuda.bindings.nvml.gpu_instance_get_vgpu_heterogeneous_mode
      • cuda.bindings.nvml.gpu_instance_get_vgpu_scheduler_log
      • cuda.bindings.nvml.gpu_instance_get_vgpu_scheduler_state
      • cuda.bindings.nvml.gpu_instance_get_vgpu_type_creatable_placements
      • cuda.bindings.nvml.gpu_instance_set_vgpu_heterogeneous_mode
      • cuda.bindings.nvml.gpu_instance_set_vgpu_scheduler_state
      • cuda.bindings.nvml.init_v2
      • cuda.bindings.nvml.init_with_flags
      • cuda.bindings.nvml.set_vgpu_version
      • cuda.bindings.nvml.shutdown
      • cuda.bindings.nvml.system_event_set_create
      • cuda.bindings.nvml.system_event_set_free
      • cuda.bindings.nvml.system_event_set_wait
      • cuda.bindings.nvml.system_get_conf_compute_capabilities
      • cuda.bindings.nvml.system_get_conf_compute_gpus_ready_state
      • cuda.bindings.nvml.system_get_conf_compute_key_rotation_threshold_info
      • cuda.bindings.nvml.system_get_conf_compute_settings
      • cuda.bindings.nvml.system_get_conf_compute_state
      • cuda.bindings.nvml.system_get_cuda_driver_version
      • cuda.bindings.nvml.system_get_cuda_driver_version_v2
      • cuda.bindings.nvml.system_get_driver_branch
      • cuda.bindings.nvml.system_get_driver_version
      • cuda.bindings.nvml.system_get_hic_version
      • cuda.bindings.nvml.system_get_nvlink_bw_mode
      • cuda.bindings.nvml.system_get_nvml_version
      • cuda.bindings.nvml.system_get_process_name
      • cuda.bindings.nvml.system_get_topology_gpu_set
      • cuda.bindings.nvml.system_register_events
      • cuda.bindings.nvml.system_set_conf_compute_gpus_ready_state
      • cuda.bindings.nvml.system_set_conf_compute_key_rotation_threshold_info
      • cuda.bindings.nvml.system_set_nvlink_bw_mode
      • cuda.bindings.nvml.unit_get_count
      • cuda.bindings.nvml.unit_get_devices
      • cuda.bindings.nvml.unit_get_fan_speed_info
      • cuda.bindings.nvml.unit_get_handle_by_index
      • cuda.bindings.nvml.unit_get_led_state
      • cuda.bindings.nvml.unit_get_psu_info
      • cuda.bindings.nvml.unit_get_temperature
      • cuda.bindings.nvml.unit_get_unit_info
      • cuda.bindings.nvml.unit_set_led_state
      • cuda.bindings.nvml.vgpu_instance_clear_accounting_pids
      • cuda.bindings.nvml.vgpu_instance_get_accounting_mode
      • cuda.bindings.nvml.vgpu_instance_get_accounting_pids
      • cuda.bindings.nvml.vgpu_instance_get_accounting_stats
      • cuda.bindings.nvml.vgpu_instance_get_ecc_mode
      • cuda.bindings.nvml.vgpu_instance_get_encoder_capacity
      • cuda.bindings.nvml.vgpu_instance_get_encoder_sessions
      • cuda.bindings.nvml.vgpu_instance_get_encoder_stats
      • cuda.bindings.nvml.vgpu_instance_get_fb_usage
      • cuda.bindings.nvml.vgpu_instance_get_fbc_sessions
      • cuda.bindings.nvml.vgpu_instance_get_fbc_stats
      • cuda.bindings.nvml.vgpu_instance_get_frame_rate_limit
      • cuda.bindings.nvml.vgpu_instance_get_gpu_instance_id
      • cuda.bindings.nvml.vgpu_instance_get_gpu_pci_id
      • cuda.bindings.nvml.vgpu_instance_get_license_info_v2
      • cuda.bindings.nvml.vgpu_instance_get_license_status
      • cuda.bindings.nvml.vgpu_instance_get_mdev_uuid
      • cuda.bindings.nvml.vgpu_instance_get_metadata
      • cuda.bindings.nvml.vgpu_instance_get_placement_id
      • cuda.bindings.nvml.vgpu_instance_get_runtime_state_size
      • cuda.bindings.nvml.vgpu_instance_get_type
      • cuda.bindings.nvml.vgpu_instance_get_uuid
      • cuda.bindings.nvml.vgpu_instance_get_vm_driver_version
      • cuda.bindings.nvml.vgpu_instance_get_vm_id
      • cuda.bindings.nvml.vgpu_instance_set_encoder_capacity
      • cuda.bindings.nvml.vgpu_type_get_bar1_info
      • cuda.bindings.nvml.vgpu_type_get_capabilities
      • cuda.bindings.nvml.vgpu_type_get_class
      • cuda.bindings.nvml.vgpu_type_get_device_id
      • cuda.bindings.nvml.vgpu_type_get_fb_reservation
      • cuda.bindings.nvml.vgpu_type_get_frame_rate_limit
      • cuda.bindings.nvml.vgpu_type_get_framebuffer_size
      • cuda.bindings.nvml.vgpu_type_get_gpu_instance_profile_id
      • cuda.bindings.nvml.vgpu_type_get_gsp_heap_size
      • cuda.bindings.nvml.vgpu_type_get_license
      • cuda.bindings.nvml.vgpu_type_get_max_instances
      • cuda.bindings.nvml.vgpu_type_get_max_instances_per_gpu_instance
      • cuda.bindings.nvml.vgpu_type_get_max_instances_per_vm
      • cuda.bindings.nvml.vgpu_type_get_name
      • cuda.bindings.nvml.vgpu_type_get_num_display_heads
      • cuda.bindings.nvml.vgpu_type_get_resolution
      • cuda.bindings.nvml.AdaptiveClockingInfoStatus
      • cuda.bindings.nvml.AffinityScope
      • cuda.bindings.nvml.BrandType
      • cuda.bindings.nvml.BridgeChipType
      • cuda.bindings.nvml.BusType
      • cuda.bindings.nvml.C2CPowerState
      • cuda.bindings.nvml.CCAcceptingClientRequests
      • cuda.bindings.nvml.CCSystemCpuCaps
      • cuda.bindings.nvml.CCSystemDevtoolsMode
      • cuda.bindings.nvml.CCSystemEnvironment
      • cuda.bindings.nvml.CCSystemFeature
      • cuda.bindings.nvml.CCSystemGpus
      • cuda.bindings.nvml.CCSystemMultiGpu
      • cuda.bindings.nvml.ClockId
      • cuda.bindings.nvml.ClockLimitId
      • cuda.bindings.nvml.ClocksEventReasons
      • cuda.bindings.nvml.ClockType
      • cuda.bindings.nvml.ComputeInstanceEngineProfile
      • cuda.bindings.nvml.ComputeInstanceProfile
      • cuda.bindings.nvml.ComputeInstanceProfileCaps
      • cuda.bindings.nvml.ComputeMode
      • cuda.bindings.nvml.CoolerControl
      • cuda.bindings.nvml.CoolerTarget
      • cuda.bindings.nvml.DetachGpuState
      • cuda.bindings.nvml.DeviceAddressingModeType
      • cuda.bindings.nvml.DeviceArch
      • cuda.bindings.nvml.DeviceGpuRecoveryAction
      • cuda.bindings.nvml.DeviceMig
      • cuda.bindings.nvml.DeviceVgpuCapability
      • cuda.bindings.nvml.DriverModel
      • cuda.bindings.nvml.EccCounterType
      • cuda.bindings.nvml.EnableState
      • cuda.bindings.nvml.EncoderQuery
      • cuda.bindings.nvml.EncoderType
      • cuda.bindings.nvml.EventType
      • cuda.bindings.nvml.FanControlPolicy
      • cuda.bindings.nvml.FanState
      • cuda.bindings.nvml.FBCSessionType
      • cuda.bindings.nvml.FieldId
      • cuda.bindings.nvml.GpmMetricId
      • cuda.bindings.nvml.GpuFabricHealthMaskAccessTimeout
      • cuda.bindings.nvml.GpuFabricHealthMaskDegradedBw
      • cuda.bindings.nvml.GpuFabricHealthMaskIncorrectConfiguration
      • cuda.bindings.nvml.GpuFabricHealthMaskRouteRecovery
      • cuda.bindings.nvml.GpuFabricHealthMaskRouteUnhealthy
      • cuda.bindings.nvml.GpuFabricHealthSummary
      • cuda.bindings.nvml.GpuFabricState
      • cuda.bindings.nvml.GpuInstanceProfile
      • cuda.bindings.nvml.GpuInstanceProfileCaps
      • cuda.bindings.nvml.GpuOperationMode
      • cuda.bindings.nvml.GpuP2PCapsIndex
      • cuda.bindings.nvml.GpuP2PStatus
      • cuda.bindings.nvml.GpuTopologyLevel
      • cuda.bindings.nvml.GpuUtilizationDomainId
      • cuda.bindings.nvml.GpuVirtualizationMode
      • cuda.bindings.nvml.GridLicenseExpiryEnum
      • cuda.bindings.nvml.GridLicenseFeatureCode
      • cuda.bindings.nvml.GridLicenseState
      • cuda.bindings.nvml.HostVgpuMode
      • cuda.bindings.nvml.InforomObject
      • cuda.bindings.nvml.InitFlag
      • cuda.bindings.nvml.IntNvLinkDeviceType
      • cuda.bindings.nvml.LedColor
      • cuda.bindings.nvml.MemoryErrorType
      • cuda.bindings.nvml.MemoryLocation
      • cuda.bindings.nvml.NvFBCSessionFlag
      • cuda.bindings.nvml.NvLinkCapability
      • cuda.bindings.nvml.NvLinkErrorCounter
      • cuda.bindings.nvml.NvlinkFirmwareUcodeType
      • cuda.bindings.nvml.NvlinkLowPowerThreshold
      • cuda.bindings.nvml.NvlinkLowPowerThresholdUnit
      • cuda.bindings.nvml.NvlinkPowerState
      • cuda.bindings.nvml.NvlinkState
      • cuda.bindings.nvml.NvLinkUtilizationCountPktTypes
      • cuda.bindings.nvml.NvLinkUtilizationCountUnits
      • cuda.bindings.nvml.NvlinkVersion
      • cuda.bindings.nvml.PageRetirementCause
      • cuda.bindings.nvml.PcieAtomicsCap
      • cuda.bindings.nvml.PcieLinkMaxSpeed
      • cuda.bindings.nvml.PcieLinkState
      • cuda.bindings.nvml.PcieUtilCounter
      • cuda.bindings.nvml.PerfPolicyType
      • cuda.bindings.nvml.PowerMizerMode
      • cuda.bindings.nvml.PowerProfileOperation
      • cuda.bindings.nvml.PowerProfileType
      • cuda.bindings.nvml.PowerScope
      • cuda.bindings.nvml.PowerSmoothingProfileParam
      • cuda.bindings.nvml.PowerSource
      • cuda.bindings.nvml.PRMCounterId
      • cuda.bindings.nvml.Pstates
      • cuda.bindings.nvml.RestrictedAPI
      • cuda.bindings.nvml.Return
      • cuda.bindings.nvml.RUSD
      • cuda.bindings.nvml.SamplingType
      • cuda.bindings.nvml.SystemEventType
      • cuda.bindings.nvml.TemperatureSensors
      • cuda.bindings.nvml.TemperatureThresholds
      • cuda.bindings.nvml.ThermalController
      • cuda.bindings.nvml.ThermalTarget
      • cuda.bindings.nvml.UUIDType
      • cuda.bindings.nvml.ValueType
      • cuda.bindings.nvml.VgpuCapability
      • cuda.bindings.nvml.VgpuDriverCapability
      • cuda.bindings.nvml.VgpuGuestInfoState
      • cuda.bindings.nvml.VgpuPgpu
      • cuda.bindings.nvml.VgpuPgpuCompatibilityLimitCode
      • cuda.bindings.nvml.VgpuPgpuVirtualizationCapMigration
      • cuda.bindings.nvml.VgpuSchedulerArr
      • cuda.bindings.nvml.VgpuSchedulerEngineType
      • cuda.bindings.nvml.VgpuSchedulerPolicy
      • cuda.bindings.nvml.VgpuVirtualizationCapMigration
      • cuda.bindings.nvml.VgpuVmCompatibility
      • cuda.bindings.nvml.VgpuVmIdType
      • cuda.bindings.nvml.AccountingStats
      • cuda.bindings.nvml.ActiveVgpuInstanceInfo_v1
      • cuda.bindings.nvml.BAR1Memory
      • cuda.bindings.nvml.BridgeChipHierarchy
      • cuda.bindings.nvml.BridgeChipInfo
      • cuda.bindings.nvml.C2cModeInfo_v1
      • cuda.bindings.nvml.ClkMonFaultInfo
      • cuda.bindings.nvml.ClkMonStatus
      • cuda.bindings.nvml.ClockOffset_v1
      • cuda.bindings.nvml.ComputeInstanceInfo
      • cuda.bindings.nvml.ComputeInstancePlacement
      • cuda.bindings.nvml.ComputeInstanceProfileInfo_v2
      • cuda.bindings.nvml.ComputeInstanceProfileInfo_v3
      • cuda.bindings.nvml.ConfComputeGpuAttestationReport
      • cuda.bindings.nvml.ConfComputeGpuCertificate
      • cuda.bindings.nvml.ConfComputeMemSizeInfo
      • cuda.bindings.nvml.ConfComputeSystemCaps
      • cuda.bindings.nvml.ConfComputeSystemState
      • cuda.bindings.nvml.CoolerInfo_v1
      • cuda.bindings.nvml.DeviceAddressingMode_v1
      • cuda.bindings.nvml.DeviceAttributes
      • cuda.bindings.nvml.DevicePowerMizerModes_v1
      • cuda.bindings.nvml.EccSramErrorStatus_v1
      • cuda.bindings.nvml.EccSramUniqueUncorrectedErrorCounts_v1
      • cuda.bindings.nvml.EccSramUniqueUncorrectedErrorEntry_v1
      • cuda.bindings.nvml.EncoderSessionInfo
      • cuda.bindings.nvml.EventData
      • cuda.bindings.nvml.ExcludedDeviceInfo
      • cuda.bindings.nvml.FBCSessionInfo
      • cuda.bindings.nvml.FBCStats
      • cuda.bindings.nvml.FieldValue
      • cuda.bindings.nvml.GpuDynamicPstatesInfo
      • cuda.bindings.nvml.GpuFabricInfo_v2
      • cuda.bindings.nvml.GpuFabricInfo_v3
      • cuda.bindings.nvml.GpuInstanceInfo
      • cuda.bindings.nvml.GpuInstancePlacement
      • cuda.bindings.nvml.GpuInstanceProfileInfo_v3
      • cuda.bindings.nvml.GpuThermalSettings
      • cuda.bindings.nvml.GridLicensableFeature
      • cuda.bindings.nvml.GridLicensableFeatures
      • cuda.bindings.nvml.GridLicenseExpiry
      • cuda.bindings.nvml.HwbcEntry
      • cuda.bindings.nvml.LedState
      • cuda.bindings.nvml.Memory
      • cuda.bindings.nvml.Memory_v2
      • cuda.bindings.nvml.NvlinkFirmwareInfo
      • cuda.bindings.nvml.NvlinkFirmwareVersion
      • cuda.bindings.nvml.NvlinkGetBwMode_v1
      • cuda.bindings.nvml.NvLinkInfo_v1
      • cuda.bindings.nvml.NvLinkInfo_v2
      • cuda.bindings.nvml.NvlinkSetBwMode_v1
      • cuda.bindings.nvml.NvlinkSupportedBwModes_v1
      • cuda.bindings.nvml.PciInfo
      • cuda.bindings.nvml.PciInfoExt_v1
      • cuda.bindings.nvml.PlatformInfo_v1
      • cuda.bindings.nvml.PlatformInfo_v2
      • cuda.bindings.nvml.PRMCounter_v1
      • cuda.bindings.nvml.PRMCounterInput_v1
      • cuda.bindings.nvml.PRMCounterValue_v1
      • cuda.bindings.nvml.ProcessDetail_v1
      • cuda.bindings.nvml.ProcessDetailList_v1
      • cuda.bindings.nvml.ProcessesUtilizationInfo_v1
      • cuda.bindings.nvml.ProcessInfo
      • cuda.bindings.nvml.ProcessUtilizationInfo_v1
      • cuda.bindings.nvml.ProcessUtilizationSample
      • cuda.bindings.nvml.PSUInfo
      • cuda.bindings.nvml.RepairStatus_v1
      • cuda.bindings.nvml.RowRemapperHistogramValues
      • cuda.bindings.nvml.Sample
      • cuda.bindings.nvml.SystemConfComputeSettings_v1
      • cuda.bindings.nvml.SystemEventData_v1
      • cuda.bindings.nvml.UnitFanInfo
      • cuda.bindings.nvml.UnitFanSpeeds
      • cuda.bindings.nvml.UnitInfo
      • cuda.bindings.nvml.Utilization
      • cuda.bindings.nvml.Value
      • cuda.bindings.nvml.VgpuCreatablePlacementInfo_v1
      • cuda.bindings.nvml.VgpuInstancesUtilizationInfo_v1
      • cuda.bindings.nvml.VgpuInstanceUtilizationInfo_v1
      • cuda.bindings.nvml.VgpuInstanceUtilizationSample
      • cuda.bindings.nvml.VgpuLicenseExpiry
      • cuda.bindings.nvml.VgpuLicenseInfo
      • cuda.bindings.nvml.VgpuMetadata
      • cuda.bindings.nvml.VgpuPgpuCompatibility
      • cuda.bindings.nvml.VgpuPgpuMetadata
      • cuda.bindings.nvml.VgpuPlacementList_v2
      • cuda.bindings.nvml.VgpuProcessesUtilizationInfo_v1
      • cuda.bindings.nvml.VgpuProcessUtilizationInfo_v1
      • cuda.bindings.nvml.VgpuSchedulerCapabilities
      • cuda.bindings.nvml.VgpuSchedulerGetState
      • cuda.bindings.nvml.VgpuSchedulerLog
      • cuda.bindings.nvml.VgpuSchedulerLogEntry
      • cuda.bindings.nvml.VgpuSchedulerLogInfo_v1
      • cuda.bindings.nvml.VgpuSchedulerParams
      • cuda.bindings.nvml.VgpuSchedulerSetParams
      • cuda.bindings.nvml.VgpuSchedulerState_v1
      • cuda.bindings.nvml.VgpuSchedulerStateInfo_v1
      • cuda.bindings.nvml.VgpuTypeBar1Info_v1
      • cuda.bindings.nvml.VgpuTypeIdInfo_v1
      • cuda.bindings.nvml.VgpuVersion
      • cuda.bindings.nvml.NvmlError
      • cuda.bindings.nvml.UninitializedError
      • cuda.bindings.nvml.InvalidArgumentError
      • cuda.bindings.nvml.NotSupportedError
      • cuda.bindings.nvml.NoPermissionError
      • cuda.bindings.nvml.AlreadyInitializedError
      • cuda.bindings.nvml.NotFoundError
      • cuda.bindings.nvml.InsufficientSizeError
      • cuda.bindings.nvml.InsufficientPowerError
      • cuda.bindings.nvml.DriverNotLoadedError
      • cuda.bindings.nvml.TimeoutError
      • cuda.bindings.nvml.IrqIssueError
      • cuda.bindings.nvml.LibraryNotFoundError
      • cuda.bindings.nvml.FunctionNotFoundError
      • cuda.bindings.nvml.CorruptedInforomError
      • cuda.bindings.nvml.GpuIsLostError
      • cuda.bindings.nvml.ResetRequiredError
      • cuda.bindings.nvml.OperatingSystemError
      • cuda.bindings.nvml.LibRmVersionMismatchError
      • cuda.bindings.nvml.InUseError
      • cuda.bindings.nvml.MemoryError
      • cuda.bindings.nvml.NoDataError
      • cuda.bindings.nvml.VgpuEccNotSupportedError
      • cuda.bindings.nvml.InsufficientResourcesError
      • cuda.bindings.nvml.FreqNotSupportedError
      • cuda.bindings.nvml.ArgumentVersionMismatchError
      • cuda.bindings.nvml.DeprecatedError
      • cuda.bindings.nvml.NotReadyError
      • cuda.bindings.nvml.GpuNotFoundError
      • cuda.bindings.nvml.InvalidStateError
      • cuda.bindings.nvml.ResetTypeNotSupportedError
      • cuda.bindings.nvml.UnknownError
    • utils
      • cuda.bindings.utils.get_cuda_native_handle
      • cuda.bindings.utils.get_minimal_required_cuda_ver_from_ptx_ver
      • cuda.bindings.utils.get_ptx_ver
  • Tips and Tricks
  • cuda.bindings Support Policy
  • Contributing
  • Code of Conduct
  • Software License Agreement

cuda.bindings: Low-level Python Bindings for CUDA#

Contents:

  • Release Notes
    • 13.2.0
    • 13.1.1
    • 13.1.0
    • 13.0.3
    • 13.0.2
    • 13.0.1
    • 13.0.0
    • 12.9.6
    • 12.9.5
    • 12.9.4
    • 12.9.3
    • 12.9.2
    • 12.9.1
    • 12.9.0
    • 12.8.0
    • 12.6.2
    • 12.6.1
    • 12.6.0
    • 12.5.0
    • 12.4.0
    • 12.3.0
    • 12.2.1
    • 12.2.0
    • 12.1.0
    • 12.0.0
    • 11.8.7
    • 11.8.6
    • 11.8.5
    • 11.8.4
    • 11.8.3
    • 11.8.2
    • 11.8.1
    • 11.8.0
    • 11.7.1
    • 11.7.0
    • 11.6.1
    • 11.6.0
    • 11.5.0
    • 11.4.0
  • Installation
    • Runtime Requirements
    • Installing from PyPI
    • Installing from Conda
    • Installing from Source
  • Overview
    • cuda.bindings workflow
    • Performance
    • Preparing kernel arguments
  • Motivation
    • What is CUDA Python?
    • Why CUDA Python?
  • Environment Variables
    • Runtime Environment Variables
    • Build-Time Environment Variables
  • CUDA Python API Reference
    • driver
    • runtime
    • nvrtc
    • nvjitlink
    • nvvm
    • nvfatbin
    • cufile
    • nvml
    • utils
  • Tips and Tricks
    • Getting the address of underlying C objects from the low-level bindings
    • Lifetime management of the CUDA objects
    • Getting and setting attributes of extension types
  • cuda.bindings Support Policy
    • Free-threading Build Support
  • Contributing
  • Code of Conduct
    • Overview
    • Our Pledge
    • Our Standards
    • Our Responsibilities
    • Scope
    • Enforcement
    • Attribution
  • Software License Agreement

Indices and tables#

  • Index

  • Module Index

  • Search Page

next

Release Notes

On this page
  • cuda.bindings: Low-level Python Bindings for CUDA
  • Indices and tables
NVIDIA NVIDIA
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2021-2025, NVIDIA.