Recurrent State Types#

struct StateSpec#

One per-slot state. shape is a single slot’s row, so the slab holding it is [slotCount] + shape and a checkpoint of it is [1] + shape.

Public Members

StateKind kind = {}#
int32_t absLayerIdx = {}#
Coords shape#
trt_edgellm::DataType dataType = {trt_edgellm::DataType::kHALF}#
char const *trt_edgellm::rt::stateKindName(StateKind kind)#

Schema spelling of a kind, shared with the layers[].states[].kind the frontends emit.