Safety_Inference Module

API documentation for the safety_inference module.

• Byte Level Bpe Tokenizer
• Container Storage
• Declared Resource Manager
• Embedding Capability
• Estd Allocator
• Estd Vector
• Fp16 Embedding
• Fp16 Embedding Kernels
• Greedy Argmax Kernel
• Greedy Sampler Capability
• Internvl3 Embedding Capability
• Internvl3 Multimodal Preprocessor Capability
• Internvl3 Preprocess Kernels
• Internvl3 Request Context
• Internvl3 Request Processing
• Internvl3 Tokenizer Capability
• Internvl3 Vanilla Inference
• Internvl Image Kernels
• Internvl Image Plan
• Lifecycle State
• LLM Model Local Data
• LLM Request Context
• Lm Stage Context
• Model Inference
• Model Inference Catalog
• Model Inference Types
• Multimodal Preprocessor Capability
• Processing Capabilities
• Processing Capability Coordinator
• Rgb Resize Normalize Kernels
• Rope Cache
• Runner Resource Resolver
• Runtime Resource
• Safety Attention Contract
• Safety Attention Kernels
• Safety Attention Modules
• Safety Attention Plugin
• Safety Blackwell Launch
• Safety Creator Registration
• Safety Error Recorder
• Safety Error State
• Safety FMHA Launch
• Safety Generation Types
• Safety Graph Initialization
• Safety Model Local Data
• Safety Plugin Export
• Safety Plugin Registry
• Safety Request Processing
• Safety Rope Kernel
• Safety Runtime
• Safety Status
• Safety Status Utils
• Safety Tensor View
• Sampler Capability
• Single Request Text Response
• Tokenizer Capability
• TRT Resource Manager
• TRT Safety Graph Executor
• TRT Safety Runner
• Vanilla Autoregressive Strategy
• Vlm Request Context