Dflash Decode Utils#

int32_t trt_edgellm::rt::dflash_utils::runtimeBlockSize(
DeploymentConfig const &deployment,
)#

Return the DFlash draft block horizon used by runtime draft forward.

DeploymentConfig resolves explicit/user-supplied DFlash horizons before the decoder is created, so the runtime reads one consolidated value.

bool trt_edgellm::rt::dflash_utils::shouldUseDDTree(
DeploymentConfig const &deployment,
)#

DFlash uses a linear-tree proposal when draftingTopK == 1 and a branching DDTree proposal when draftingTopK > 1.