XQA Kernel Support

bool trt_edgellm::canCompileXQAKernel(

int32_t numQHeads,

int32_t numKVHeads,

int32_t headSize,

int32_t smVersion,

trt_edgellm::DataType dataType,

trt_edgellm::DataType kvDataType

) noexcept

Check if a given configuration can produce a valid XQA JIT kernel.

Note

Pure: no NVRTC or CUDA driver dependency, so the runtime links it as well as the plugin.