Safety Plugin Loader

class SafetyPluginRegistration

Public Functions

virtual ~SafetyPluginRegistration() noexcept = default

virtual bool initializeAttentionModules(

bool remoteAutoTuning

) noexcept = 0

Bind attention creators before parsing ONNX; remote tuning performs no local CUDA setup.

virtual bool completeGpuWork() noexcept = 0

Complete profiling while TRT objects and their borrowed buffers are still alive.

virtual bool finishBuild() noexcept = 0

Destroy all TRT objects first. Returns false if GPU completion or teardown fails.

struct SafetyPluginDescriptor

Public Members

char const *pluginNamespace

char const *pluginName

char const *pluginVersion

std::unique_ptr<SafetyPluginRegistration> trt_edgellm::safety::builder::loadSafetyPlugins(

std::string const &configuredPath,

std::initializer_list<SafetyPluginDescriptor> requiredPlugins

)

Load the Safety plugin library and register the required creators. The returned object keeps the library loaded and deregisters creators before unloading it.