Safety Model Local Data

class SafetyModelLocalData

SafetyRuntime owns the object; payload storage is borrowed from PreparedResources. Destroy the object before releasing declared resources. Destruction performs no CUDA/DLI calls.

Subclassed by trt_edgellm::safety::llm::ModelLocalData

Public Functions

virtual ~SafetyModelLocalData() = default

class SafetyModelLocalDataFactory

Configured from immutable artifacts and stage metadata during Initialization.

Subclassed by trt_edgellm::safety::llm::ModelLocalDataFactory

Public Functions

virtual ~SafetyModelLocalDataFactory() = default

virtual SafetyStatus declareResources(

ResourceDeclaration &output

) const noexcept = 0

virtual SafetyStatus create(

PreparedResources const &resources,

std::unique_ptr<SafetyModelLocalData> &output

) const noexcept = 0

Construct metadata over prepared storage; transfer object ownership to SafetyRuntime.

struct SafetyModelLocalDataPlan

Public Members

std::size_t resourceSlot = {0}

std::string name = {}

SafetyModelLocalDataFactory const *factory = {nullptr}