I am trying to test:
only yolov5 without openvino : ~ 4 FPS
yolov5 with openvino : ~ 2 FPS
That is abnormal, can you give me any suggest or any comparison between two methods if you already compared between them.
YOLOv5 is officially validated and supported on OpenVINO 2021.4. Might be the result that you obtained is based on a non-validated version. As such, I would recommend you to use the latest version of OpenVINO Toolkit. In addition, YOLOv5 is available in four models, namely s, m, l, and x, each one of them offering different detection accuracy and performance. Refer to YOLOv5 for more information.