Runner Resource Resolver#
-
class RunnerResourceResolver : public trt_edgellm::safety::BorrowedResourceResolver#
Converts prepared Runner bindings into stable borrowed resource views during Initialization. Runner IO/streams and the model-local registry outlive all consumers. The registry may grow while factories are initialized; published objects stay at stable addresses. Destruction releases only metadata.
Public Functions
- explicit RunnerResourceResolver(
- std::vector<ModelLocalDataBinding> const &modelLocalData
-
RunnerResourceResolver(RunnerResourceResolver const&) = delete#
- RunnerResourceResolver &operator=(
- RunnerResourceResolver const&
- SafetyStatus prepare(
- std::vector<LMStageContext> const &contexts
Snapshot singleton-profile contexts before resolving any declarations; callable once on success.
- virtual SafetyStatus resolve(
- RuntimeBorrowedResourceRequest const &request,
- RuntimeBorrowedResource &output
-
struct ModelLocalDataBinding#
Runtime-owned object published after its factory has resolved prepared storage.
Public Members
-
ResourceSlotId slot = {0}#
-
std::string name = {}#
-
SafetyModelLocalData *object = {nullptr}#
-
ResourceSlotId slot = {0}#
- SafetyStatus trt_edgellm::safety::describeRuntimeTensor(
- SafetyTensorView const &tensor,
- int64_t profile,
- RuntimeTensorDesc &output
Initialization-only conversion of a linear, non-vectorized fixed-profile binding.