Object Class FP32 CPU FP16 GPU INT8 GPU TensorRT ONNX Runtime Pedestrian 54.6ms 26.7ms 24.8ms 14.2ms 28.2ms Vehicle 47.8ms 23.8ms 21.3ms 11.5ms 21.5ms Cyclist 50.8ms 23.1ms 26.7ms 10.3ms 22.1ms Traffic Sign 53.2ms 25.4ms 24.7ms 9.2ms 26.4ms Traffic Light 52.5ms 25.6ms 23.3ms 9.5ms 24.6ms Road Marking 51.5ms 25.2ms 25.2ms 13.6ms 25.9ms Construction 51.3ms 23.4ms 27.0ms 11.3ms 25.4ms Animal 53.5ms 22.5ms 25.6ms 11.4ms 23.5ms