Ragged Plugin Metadata

struct RaggedPluginMetadata

Public Members

int32_t numSequences

int32_t numContextSequences

int32_t numDecodeSequences

int32_t physicalTokens

int32_t contextExecutionRows

T_exec - N_decode; split geometry for ordinary context/decode work.

int32_t decodeExecutionRows

N_decode; phase 8 permanently limits decode suffixes to one row each.

rt::ExecutionPhase phase