This is a cache of https://discuss.96boards.org/t/is-snpe-gpu-supported-on-rb5-or-rb3-linaro-os/11475. It is a snapshot of the page at 2024-11-01T01:21:39.395+0000.
Is SNPE GPU supported on RB5 or RB3 linaro OS? - Qualcomm RB5 - 96Boards Forum

Is SNPE GPU supported on RB5 or RB3 linaro OS?

Products Support Qualcomm RB5
#1

Hi,
I am trying to run a neural network on the GPU of RB3 and/or RB5. Does the linaro OS for either of these boards support Snapdragon Neural Processing Engine SDK (GPU)?
I was able to run the neural network on the CPU using instructions here, but not able to run the network on the GPU.

Thank you

SNPE using Python on the QRB5165 - Linaro Debian Trixie/Sid image
#2

Hi, have a look at these instructions to run SNPE on RB3 on Hexagon CDSP. https://github.com/96boards/documentation/wiki/Dragonboard-Hexagon-DSP#running-snapdragon-neural-processing-engine-on-db845c

I have not tried it on GPU. You would need OpenCL for GPU backend. I have not spent any time investigating on this.

–srini

#3

Hi @srini
Thank you for the response. I faced a few bumps while trying to follow your instructions for running DSP on RB3.

Setup:
linaro OS - Linux linaro-gnome 5.13.0-qcomlt-arm64 #202 SMP PREEMPT Fri Aug 13 02:49:49 UTC 2021 aarch64
gcc version - gcc (Debian 10.2.1-6) 10.2.1 20210110
SNPE 1.54.2.2899 on ubuntu 18.04 Host machine.

Problems faced:

  1. Copy command from here gives the following no disk space left error:

linaro@linaro-gnome:~$ sudo mount /dev/disk/by-partlabel/dsp_a /dsp
linaro@linaro-gnome:~$ sudo cp ~/snpe/dsp/* /dsp/cdsp/
cp: error writing ‘/dsp/cdsp/libcalculator_skel.so’: No space left on device
cp: error writing ‘/dsp/cdsp/libsnpe_dsp_v65_domains_v2_skel.so’: No space left on device
cp: error writing ‘/dsp/cdsp/libsnpe_dsp_v66_domains_v2_skel.so’: No space left on device
cp: error writing ‘/dsp/cdsp/libsnpe_dsp_v68_domains_v3_skel.so’: No space left on device
linaro@linaro-gnome:~$ df -h
> /dev/sde9 28M 27M 0 100% /dsp

  1. Location of libcdsprpc.so and libc.so are different than instructions.

linaro@linaro-gnome:~$ locate libc.so
/lib/aarch64-linux-gnu/libc.so.6
> /usr/lib/aarch64-linux-gnu/libc.so

linaro@linaro-gnome:~$ locate libcdsprpc
/usr/lib/aarch64-linux-gnu/libcdsprpc.la
> /usr/lib/aarch64-linux-gnu/libcdsprpc.so
/usr/lib/aarch64-linux-gnu/libcdsprpc.so.0
/usr/lib/aarch64-linux-gnu/libcdsprpc.so.0.0.0

which leads to the following runtime error:

linaro@linaro-gnome:~$ export ADSP_LIBRARY_PATH=/dsp/cdsp
linaro@linaro-gnome:~$ sudo cdsprpcd&
[1] 2079
linaro@linaro-gnome:~$ echo $LD_LIBRARY_PATH

linaro@linaro-gnome:~$ export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/linaro/snpe/lib
linaro@linaro-gnome:~$ ls snpe/lib/lib
libPlatformValidatorShared.so libcalculator.so libsnpe_dsp_domains_v2.so
libSNPE.so libhta.so
linaro@linaro-gnome:~$ ls snpe/lib/lib^C
linaro@linaro-gnome:~$ ^C
linaro@linaro-gnome:~$ export PATH=$PATH:/home/linaro/snpe/bin
linaro@linaro-gnome:~$ locate libcdsprpc
/usr/lib/aarch64-linux-gnu/libcdsprpc.la
/usr/lib/aarch64-linux-gnu/libcdsprpc.so
/usr/lib/aarch64-linux-gnu/libcdsprpc.so.0
/usr/lib/aarch64-linux-gnu/libcdsprpc.so.0.0.0
linaro@linaro-gnome:~$ LD_PRELOAD=/usr/local/lib/libcdsprpc.so snpe-platform-validator --runtime dsp
ERROR: ld.so: object ‘/usr/local/lib/libcdsprpc.so’ from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
PF_VALIDATOR: DEBUG: Calling PlatformValidator->setRuntime
PF_VALIDATOR: DEBUG: Calling PlatformValidator->RuntimeCheck
PF_VALIDATOR: DEBUG: Testing for the support of DSP runtime.
src/rpcmem_android.c:134:stat Failed on /dev/ion hello snpe-platform-validator - fastrpc_apps_user.c:1068: Error: remote_handle_control_domain: remote handle control called with unsupported request ID 2hello snpe-platform-validator - fastrpc_apps_user.c:1073: Error 0x6c: remote_handle_control_domain failed for request ID 2 on domain 3hello snpe-platform-validator - fastrpc_apps_user.c:1084: Error 0x6c: remote_handle_control failed for request ID 2hello snpe-platform-validator - fastrpc_apps_user.c:1491: Error: Device node open failed for domain 3 (errno Permission denied)hello snpe-platform-validator - fastrpc_apps_user.c:1704: Error 0x57: apps_dev_init failed for domain 3, errno Permission denied
hello snpe-platform-validator - fastrpc_apps_user.c:1799: Error 57: open dev -1 for domain 3 failed
hello snpe-platform-validator - fastrpc_apps_user.c:1491: Error: Device node open failed for domain 3 (errno Permission denied)hello snpe-platform-validator - fastrpc_apps_user.c:1704: Error 0x57: apps_dev_init failed for domain 3, errno Permission denied
hello snpe-platform-validator - fastrpc_apps_user.c:1799: Error 57: open dev -1 for domain 3 failed
PF_VALIDATOR: DEBUG: CPU side validation failed.

PF_VALIDATOR: ERROR: All the libraries needed for SNPE DSP are not present. Files missing: /lib/libc.so.6,/usr/lib/libadsprpc.so,
Unit Test on the runtime DSP: Failed.
SNPE is NOT supported for runtime DSP on the device.
PF_VALIDATOR: DEBUG: Calling PlatformValidator->IsRuntimeAvailable
PF_VALIDATOR: DEBUG: CPU side validation failed.

PF_VALIDATOR: ERROR: All the libraries needed for SNPE DSP are not present. Files missing: /lib/libc.so.6,/usr/lib/libadsprpc.so,
Runtime DSP Prerequisites: Absent.
Error in saving the results

Same errors when I do these steps as root.

  1. The latest SNPE only gives me the option of gcc7.5 which does not match the latest RB3 linaro gcc. Should I try an older version of linaro? if so, which one?

kshitij@geode:~/projects/waar3d/snpe/snpe-1.54.2.2899/lib$ ls
aarch64-android-clang6.0 aarch64-oe-linux-gcc9.3 arm-android-clang6.0 dsp x86_64-linux-clang
aarch64-oe-linux-gcc8.2 aarch64-ubuntu-gcc7.5 arm-oe-linux-gcc8.2hf python

Thank you
Kshitij