decode_prefill#
Differentiable explicit per-sequence prefill/decode phase handoff.
Functions
Supply explicit sequence phases through forward and checkpointed backward. |
- linear_attention_training_phase(model, prefill_lengths)#
Supply explicit sequence phases through forward and checkpointed backward.
Runtime phase metadata is local to the converted layers and restored on exit. Keep this context active through backward when activation checkpointing is used.