dflash_model
DFlash model to support block-wise parallel speculative decoding.
Classes
Base DFlash Model. |
- class DFlashModel
Bases:
DynamicModuleBase DFlash Model.
- modify(config)
Base DFlash Model modify function. Child class should implement the details.