Remote Auto Tuning Utils#
-
class ScopedTensorRTCpuOnlyMode#
Process-scoped TensorRT CPU-only mode for Safety remote auto-tuning.
TRT 11.3 lacks a public CPU-only configuration API. Follow TRT’s trtexec approach by setting TRT_INTERNAL_OPTIONS=–cpu_only=1 before builder creation. Restore the caller’s environment after the build. TODO: Use the public CPU-only configuration API when available.
Public Functions
-
ScopedTensorRTCpuOnlyMode() = default#
-
ScopedTensorRTCpuOnlyMode(ScopedTensorRTCpuOnlyMode const&) = delete#
- ScopedTensorRTCpuOnlyMode &operator=(
- ScopedTensorRTCpuOnlyMode const&
-
inline ~ScopedTensorRTCpuOnlyMode() noexcept#
-
inline bool enable() noexcept#
-
ScopedTensorRTCpuOnlyMode() = default#