You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I was wondering what were your benchmark parameters? I would guess you used trtexec for benchmarking?
Unfortunately, I can't reach your benchmarking numbers with this command on colab: !trtexec --onnx=original.onnx --saveEngine=original.engine --shapes=images:1x3x640x640 --fp16 --noDataTransfers --useCudaGraph --builderOptimizationLevel=5 --maxAuxStreams=10 --useSpinWait --warmUp=20 --iterations=2000 --memPoolSize=workspace:7g
The lowest number I ever got, was 9.2ms (vs. 8.07 ms reported in the paper). I tried with and without maxAuxStreams and a lower --builderOptimizationLevel=5.
Activity
SebastianJanampa commentedon Mar 28, 2026
Hi,
You could try using the single-benchmark-artifact repo developed by Roboflow.
altair199797 commentedon Mar 28, 2026
Thanks for pointing out!