Vision Pt. 2
Over the past month, I have mostly dedicated my resources towards testing out the best case scenario for running openCV on the RB3.
Incase you haven’t seen my previous blog on Introduction to OpenCV on RB3 I’d recommend giving that a quick read before continuing.
Ditching OpenCV 4 for OpenCV 3.2 because of buggy OpenMP implementation
Ever wondered why OpenCV stresses your CPU really well, across all the cores?
It utilizes a few multi-threading algorithms and libraries so that even if your code is highly sequential, most of the processing intensive OpenCV functions you call are atleast parallelized internally.
This allows for a smoother programming experience and efficient utilization of the available CPU power.
Otherwise you are stuck with your openCV code running on a single core, and no matter how powerful your processor’s single core performance is, you’ll always have a bad time.
OpenCV is flexible in a way that it allows you to choose which multi-threading library you want it to utilize, this allows for a lot of flexibility and performance optimizations.
So what choices do we have?
Here we are faced with a few options:
- PThreads: Basic, widely available but I’d recommend this only as a last resort.
- TBB: Optimized for Intel chipsets, performs poorly on ARM so I don’t really care.
- IPP: Works ONLY with Intel chipsets so I can’t be bothered with this one either.
- OpenMP: Completely open-source, built into gcc/libc, architecture independent. Great opencv performance for Arm.
OpenMP it is then.
Yes but, Not quiet. Currently there seems to be a bug in OpenCV 4 preventing (at least) ARM64 platforms from using OpenMP (at least) in Python 3 & 2.
Bug reported here: https://github.com/opencv/opencv/issues/14884
After doing multiple experiments with different gcc variants, opencv versions etc, I’ve come to the conclusion that using tried and tested OpenCv 3.2 with OpenMP enabled is the best solution.
Its not that old of a version and allows your workload to be split across multiple cores, which combined with the powerful Snapdragon 845 on the RB3 means that all but one core are always sitting under 50% utilization.
I mean just look at this screenshot.
We’ll take a look at the OpenCV implementation for the Robotic Arm Project.
This article is Part 3 in a 10-Part Series.
- Part 1 - Qualcomm RB3 Robotic Arm Project | Introduction
- Part 2 - OpenCV on RB3 Pt. 1 | Qualcomm RB3 Robotic Arm Project
- Part 3 - Threads got complicated | OpenCV on RB3 Pt. 2 | Qualcomm RB3 Robotic Arm Project
- Part 4 - Gimme Code | OpenCV on RB3 Pt. 3 | Qualcomm RB3 Robotic Arm Project
- Part 5 - My experiments with 1080p | OpenCV on RB3 Pt. 4 | Qualcomm RB3 Robotic Arm Project
- Part 6 - Setup RB3 for the Robotic Arm Project | OpenCV on RB3 Pt. 0 | Qualcomm RB3 Robotic Arm Project
- Part 7 - Speech Recognition and Combining Voice with Vision | OpenCV on RB3 Pt. 5 | Qualcomm RB3 Robotic Arm Project
- Part 8 - It's ALIVE | OpenCV on RB3 Pt. 6 | Qualcomm RB3 Robotic Arm Project
- Part 9 - Out with Arduino, In with i2c and PCA9685 | OpenCV on RB3 Pt. 7 | Qualcomm RB3 Robotic Arm Project
- Part 10 - The RB3 Robotic Arm