cuda.bindings._v2.driver.kernel_set_cache_config#

cuda.bindings._v2.driver.kernel_set_cache_config(intptr_t kernel, int config, int dev)#

Sets the preferred cache configuration for a device kernel.

On devices where the L1 cache and shared memory use the same hardware resources, this sets through config the preferred cache configuration for the device kernel kernel on the requested device dev. This is only a preference. The driver will use the requested configuration if possible, but it is free to choose a different configuration if required to execute kernel. Any context-wide preference set via ctx_set_cache_config() will be overridden by this per-kernel setting. Note that attributes set using func_set_cache_config() will override the attribute set by this API irrespective of whether the call to func_set_cache_config() is made before or after this API call. This setting does nothing on devices where the size of the L1 cache and shared memory are fixed. Launching a kernel with a different preference than the most recent preference setting may insert a device-side synchronization point. The supported cache configurations are:.

CU_FUNC_CACHE_PREFER_NONE: no preference for shared memory or L1 (default).
CU_FUNC_CACHE_PREFER_SHARED: prefer larger shared memory and smaller L1 cache.
CU_FUNC_CACHE_PREFER_L1: prefer larger L1 cache and smaller shared memory.
CU_FUNC_CACHE_PREFER_EQUAL: prefer equal sized L1 cache and shared memory.

Parameters:

kernel (intptr_t) – Kernel to configure cache for.
config (FuncCache) – Requested cache configuration.
dev (int) – Device to set attribute of.

Note

The API has stricter locking requirements in comparison to its legacy counterpart func_set_cache_config() due to device-wide semantics. If multiple threads are trying to set a config on the same device simultaneously, the cache config setting will depend on the interleavings chosen by the OS scheduler and memory consistency.