Speculative Kernels Utils

namespace trt_edgellm

namespace kernel

Functions

inline size_t alignSpeculativeWorkspaceSize(size_t size)

Variables

size_t kSpeculativeWorkspaceAlignment = {256U}

Workspace alignment used by speculative CUDA kernels.