Mtp State Scatter Kernels#
-
struct MtpLayerInfo#
Per-layer pointer bundle for batched MTP state scatter (analogous to KVLayerInfo).
Public Members
-
void *recurrentDst#
Main recurrent state pool [batchSize, recElements] FP32.
-
void *recurrentSrc#
Intermediate recurrent state buffer [batchSize, verifyTreeSize, recElements] FP32.
-
void *convDst#
Main conv state pool [batchSize, convElements] FP16.
-
void *convSrc#
Intermediate conv state buffer [batchSize, verifyTreeSize, convElements] FP16.
-
void *recurrentDst#