Reference documentation

• Compilation API
• CUDA Kernel API
  • Kernel declaration
  • Dispatcher objects
  • Kernel Arguments
  • Intrinsic Attributes and Functions
    • Thread Indexing
      • threadIdx
      • blockIdx
      • blockDim
      • gridDim
      • laneid
      • warpsize
      • grid()
      • gridsize()
    • Memory Management
      • array()
      • array()
      • array_like()
    • Synchronization and Atomic Operations
      • add()
      • sub()
      • and_()
      • or_()
      • xor()
      • exch()
      • inc()
      • dec()
      • max()
      • cas()
      • syncthreads()
      • syncthreads_count()
      • syncthreads_and()
      • syncthreads_or()
    • Cooperative Groups
      • this_grid()
      • GridGroup
        • sync()
    • Memory Fences
      • threadfence()
      • threadfence_block()
      • threadfence_system()
    • Warp Intrinsics
      • syncwarp()
      • all_sync()
      • any_sync()
      • eq_sync()
      • ballot_sync()
      • shfl_sync()
      • shfl_up_sync()
      • shfl_down_sync()
      • shfl_xor_sync()
      • match_any_sync()
      • match_all_sync()
      • activemask()
      • lanemask_lt()
    • Integer Intrinsics
      • popc()
      • brev()
      • clz()
      • ffs()
    • Floating Point Intrinsics
      • fma()
      • cbrt()
    • 16-bit Floating Point Intrinsics
      • is_float16_supported()
      • hfma()
      • hadd()
      • hsub()
      • hmul()
      • hdiv()
      • hneg()
      • habs()
      • hsin()
      • hcos()
      • hlog()
      • hlog10()
      • hlog2()
      • hexp()
      • hexp10()
      • hexp2()
      • hfloor()
      • hceil()
      • hsqrt()
      • hrsqrt()
      • hrcp()
      • hrint()
      • htrunc()
      • heq()
      • hne()
      • hgt()
      • hge()
      • hlt()
      • hle()
      • hmax()
      • hmin()
    • Control Flow Instructions
      • selp()
    • Timer Intrinsics
      • nanosleep()
• Cache Hints for Memory Operations
  • ldca()
  • ldcg()
  • ldcs()
  • ldlu()
  • ldcv()
  • stcg()
  • stcs()
  • stwb()
  • stwt()
• CUDA-Specific Types
  • Vector Types
  • Narrow Data Types
    • Bfloat16
      • is_bfloat16_supported()
      • Data Movement and Casts
        • bfloat16()
      • Arithmetic
      • Math Intrinsics
        • htrunc()
        • hceil()
        • hfloor()
        • hrint()
        • hsqrt()
        • hrsqrt()
        • hrcp()
        • hlog()
        • hlog2()
        • hlog10()
        • hcos()
        • hsin()
        • htanh()
        • htanh_approx()
        • hexp()
        • hexp2()
        • hexp10()
      • Arithmetic Intrinsics
        • habs()
        • hneg()
        • hadd()
        • hadd_rn()
        • hadd_sat()
        • hsub()
        • hsub_rn()
        • hsub_sat()
        • hmul()
        • hmul_rn()
        • hmul_sat()
        • hdiv()
        • hfma()
        • hfma_sat()
        • hfma_relu()
      • Comparison Intrinsics
        • heq()
        • hne()
        • hge()
        • hgt()
        • hle()
        • hlt()
        • hequ()
        • hneu()
        • hgeu()
        • hgtu()
        • hleu()
        • hltu()
        • hmax()
        • hmin()
        • hmax_nan()
        • hmin_nan()
        • hisnan()
        • hisinf()
      • Precision Conversion and Data Movement
        • Floating-point conversions
          • float32_to_bfloat16()
          • float64_to_bfloat16()
          • bfloat16_to_float32()
          • float32_to_bfloat16_rn()
          • float32_to_bfloat16_rz()
          • float32_to_bfloat16_rd()
          • float32_to_bfloat16_ru()
        • Integer conversions
          • int16 (signed 16-bit)
            • int16_to_bfloat16_rn()
            • int16_to_bfloat16_rz()
            • int16_to_bfloat16_rd()
            • int16_to_bfloat16_ru()
            • bfloat16_to_int16_rn()
            • bfloat16_to_int16_rz()
            • bfloat16_to_int16_rd()
            • bfloat16_to_int16_ru()
          • uint16 (unsigned 16-bit)
            • uint16_to_bfloat16_rn()
            • uint16_to_bfloat16_rz()
            • uint16_to_bfloat16_rd()
            • uint16_to_bfloat16_ru()
            • bfloat16_to_uint16_rn()
            • bfloat16_to_uint16_rz()
            • bfloat16_to_uint16_rd()
            • bfloat16_to_uint16_ru()
          • int32 (signed 32-bit)
            • int32_to_bfloat16_rn()
            • int32_to_bfloat16_rz()
            • int32_to_bfloat16_rd()
            • int32_to_bfloat16_ru()
            • bfloat16_to_int32_rn()
            • bfloat16_to_int32_rz()
            • bfloat16_to_int32_rd()
            • bfloat16_to_int32_ru()
          • uint32 (unsigned 32-bit)
            • uint32_to_bfloat16_rn()
            • uint32_to_bfloat16_rz()
            • uint32_to_bfloat16_rd()
            • uint32_to_bfloat16_ru()
            • bfloat16_to_uint32_rn()
            • bfloat16_to_uint32_rz()
            • bfloat16_to_uint32_rd()
            • bfloat16_to_uint32_ru()
          • int64 (signed 64-bit)
            • int64_to_bfloat16_rn()
            • int64_to_bfloat16_rz()
            • int64_to_bfloat16_rd()
            • int64_to_bfloat16_ru()
            • bfloat16_to_int64_rn()
            • bfloat16_to_int64_rz()
            • bfloat16_to_int64_rd()
            • bfloat16_to_int64_ru()
          • uint64 (unsigned 64-bit)
            • uint64_to_bfloat16_rn()
            • uint64_to_bfloat16_rz()
            • uint64_to_bfloat16_rd()
            • uint64_to_bfloat16_ru()
            • bfloat16_to_uint64_rn()
            • bfloat16_to_uint64_rz()
            • bfloat16_to_uint64_rd()
            • bfloat16_to_uint64_ru()
        • 8-bit conversions
          • bfloat16_to_int8_rz()
          • bfloat16_to_uint8_rz()
        • Bit Reinterpret Casts
          • bfloat16_as_int16()
          • bfloat16_as_uint16()
          • int16_as_bfloat16()
          • uint16_as_bfloat16()
• Libdevice functions
  • Wrapped functions
• Environment Variables
• CUDA Host API (Deprecated)
  • Device Management
    • Device detection and enquiry
    • Context management
    • Device management
      • gpus
      • current
      • Device
        • compute_capability
        • id
        • name
        • uuid
        • reset()
        • supports_float16
    • Events
  • Stream Management
• Memory Management (Deprecated)
  • Device Objects