Best 2 Batch Inference Open Source Projects

Onnx Tensorrt Project

Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/Cent...

Yolov5 Torchserve

Torchserve server using a YoloV5 model running on docker with GPU and st...