KvHintsEnvelope#

class tensorrt_llm.llmapi.KvHintsEnvelope(

*,

protocol_version: Annotated[str, MinLen(min_length=1)],

message_id: Annotated[str, MinLen(min_length=1)],

actions: list[KvHintAction],

**extra_data: Any,

)[source]#

Bases: BaseModel

Versioned KV hints transported as prototype per-request metadata.

Unknown action types, action versions and optional JSON fields are preserved. Consumers must negotiate and validate executable actions separately from this wire format.

field actions: list[KvHintAction] [Required]#: Actions in their producer-specified order.

field message_id: str [Required]#

Producer’s hint message identifier.

Constraints:

min_length = 1

field protocol_version: str [Required]#

KV hint envelope protocol version; unsupported versions are ignored at admission.

Constraints:

min_length = 1

__init__(**data: Any) → None#

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.