Optimizing opencv 3.4 in Raspberry Pi 3 using GStreamer

Optimizing opencv 3.4 in Raspberry Pi 3 using GStreamer

In this tutorial we will follow the steps to build an opencv library optimized for the raspberry pi3 arm cortex processor.

This optimizations consist on building OpenCV binaries that make use of the NEON instructions and VFPV architecture. These technologies are a great aid when dealing with large arrays of data, and SIMD instructions.

 

Step 1: Dependencies

Delete Wolfram Engine and LibreOffice to free 500MB ~ 1GB of disk space:

sudo apt-get purge wolfram-engine

sudo apt-get purge libreoffice*

sudo apt-get clean

sudo apt-get autoremove

 

Update and upgrade your current packages, and install opencv dependencies:

 

sudo apt update && sudo apt upgrade

sudo apt install -y build-essential cmake pkg-config

sudo apt install -y libjpeg-dev libtiff5-dev libjasper-dev libpng12-dev

sudo apt install -y libavcodec-dev libavformat-dev libswscale-dev libv4l-dev

sudo apt install -y libgtk2.0-dev libgtk-3-dev

sudo apt install -y libcanberra-gtk*

sudo apt install -y libatlas-base-dev gfortran

sudo apt install -y python2.7-dev python3-dev

 

# x264 libraries

sudo apt install -y libxvidcore-dev libx264-dev

 

# GStreamer libraries

sudo apt install -y libgstreamer1.0-

sudo apt install -y libgstreamer-plugins-base1.0-

sudo apt install -y gstreamer1.0-plugins-*

 

Step 2: Download OpenCV

Download Opencv 2.4.13.5 from https://opencv.org/releases.html

$ cd

$ wget https://github.com/opencv/opencv/archive/3.4.1.zip

$ unzip 3.4.1.zip

$ wget -O opencv_contrib.zip https://github.com/Itseez/opencv_contrib/archive/3.4.1.zip

$ unzip opencv_contrib.zip

$ cd opencv-3.4.1/

 

Step 3: Edit the compiler options

Open the file opencvcompileroptions.cmake :

$ nano cmake/OpenCVCompilerOptions.cmake

Locate the line containing:

# ocv_update(CPU_VFPV3_FLAGS_ON “-mfpu=vfpv3”)

And replace it with:

# ocv_update(CPU_VFPV3_FLAGS_ON “-mcpu=cortex-a7 -mfpu=neon-vfpv4 -ftree-vectorize -mfloat-abi=hard”)

Save the file, verify the changes made.

 

Step 4: Increase the swap size

Now, let’s increase the swap size so gcc can use all 4 cores of the Raspberry Pi 3.

Open the file /etc/dphys-swapfile and edit CONF_SWAPSIZE variable:

CONF_SWAPSIZE=1024

If you do not perform this step it’s very likely that gcc will crash when building the libraries using 4 threads.

Remember to change the swap size back to CONF_SWAPSIZE=100 once the installation is done.

WARNING: Increasing the SWAP_SIZE will reduce the lifespan of your SD card due to multiple rewrites in the flash card. Please consider doing a backup of your SD-card. Avoid using this SD-card for a final product, instead consider cloning the content of the memory into an SD-card image once your product is fully configured (with all its dependencies compiled and installed).

Restart the swapfile service:

$ sudo /etc/init.d/dphys-swapfile stop

$ sudo /etc/init.d/dphys-swapfile start

 

Use htop to verify that the swap size increased.

$ htop

 

Step 5: Compile and install OpenCV

Now let’s build opencv libraries:

$ mkdir build

$ cd build

cmake \

-D CMAKE_BUILD_TYPE=RELEASE \

-D OPENCV_EXTRA_MODULES_PATH=~/opencv_contrib/modules \

-D ENABLE_NEON=ON \

-D ENABLE_VFPV3=ON \

-D WITH_TBB=ON \

-D WITH_GSTREAMER=ON \

-D EXTRA_C_FLAGS=-mcpu=cortex-a7 -mfpu=neon-vfpv4 -ftree-vectorize -mfloat-abi=hard \

-D EXTRA_CXX_FLAGS=-mcpu=cortex-a7 -mfpu=neon-vfpv4 -ftree-vectorize -mfloat-abi=hard \

-D BUILD_TESTS=OFF \

-D WITH_LAPACK=OFF \

-D WITH_EIGEN=OFF \

-D INSTALL_C_EXAMPLES=OFF \

-D INSTALL_PYTHON_EXAMPLES=OFF \

-D BUILD_EXAMPLES=OFF ..

 

Here comes the time consuming part, now run:

$ make -j4

And wait for 2-3 hours until it finishes. Remember to check the process every now and then.

Note: using a heatsink for the processor and keeping it as cool as possible, will likely reduce the compilation time.

When (and if) OpenCV is finally compiled, install it in the linux system using:

$ sudo make install

$ sudo ldconfig

 

Step 6: Decrease the swap size

Edit the file /etc/dphys-swapfile and change the CONF_SWAPSIZE variable:

CONF_SWAPSIZE=100

Restart the swapfile service:

$ sudo /etc/init.d/dphys-swapfile stop

$ sudo /etc/init.d/dphys-swapfile start

 

Now you can have an OpenCV built to make the best use of the processor in your Raspberry Pi 3.

 

Changes for opencv 3.1

In step 2, download opencv 3.1 with:

$ wget -O opencv.zip https://github.com/Itseez/opencv/archive/3.3.0.zip

$ unzip opencv.zip

$ wget -O opencv_contrib.zip https://github.com/Itseez/opencv_contrib/archive/3.3.0.zip

$ unzip opencv_contrib.zip

 

In step 5, add the flag:

-D OPENCV_EXTRA_MODULES_PATH=~/opencv_contrib-3.3.0/modules

 

References:

http://hopkinsdev.blogspot.com.co/2016/06/opencv-310-optimized-for-raspberry-pi.html

https://www.pyimagesearch.com/2017/10/09/optimizing-opencv-on-the-raspberry-pi/

http://ebenezertechs.com/instalar-opencv-2-4-13-en-ubuntu-14-04-y-16-04/

https://www.pexels.com

, , , , ,
ZH-CN NL EN DE PT RU ES