search

intel / libxcam

libXCam is a project for extended camera(not limited in camera) features and focus on image quality improvement and video analysis. There are lots features supported in image pre-processing, image post-processing and smart analysis. This library makes GPU/CPU/ISP working together to improve image quality. OpenCL is used to improve performance in different platforms.
Other
592 stars 230 forks source link

Fail in test-cl-image #449

Closed lenovoivc closed 7 years ago

lenovoivc commented 7 years ago

Try to compile beignet and libxcam on Ubuntu 16.04 / CUDA 8.0. Finally, when trying: ./test-cl-image -t retinex -f RGBA -i ./input.png -o ./output.png the errors below occur: /libxcam/tests/.libs/lt-test-cl-image: /usr/local/cuda-8.0/lib64/libOpenCL.so.1: no version information available (required by /libxcam/modules/ocl/.libs/libxcam_ocl.so.1) X server found. dri2 connection failed! DRM_IOCTL_I915_GEM_APERTURE failed: Invalid argument Assuming 131072kB available aperture size. May lead to reduced performance or incorrect rendering. get chip id failed: -1 [22] param: 4, val: 0 cl_get_gt_device(): error, unknown device: 0 XCAM WARNING cl_device.cpp:113: get cl device ID failed XCAM WARNING cl_device.cpp:52: CL device init failed XCAM DEBUG cl_device.cpp:54: CL device constructed lt-test-cl-image: cl_kernel.cpp:39: XCam::CLKernel::CLKernel(const XCam::SmartPtr&, const char*): Assertion `context.ptr ()' failed. Aborted (core dumped)

Actually, the errors below have occurred during Make: make all-recursive make[1]: Entering directory '/libxcam' Making all in xcore make[2]: Entering directory '/libxcam/xcore' make[2]: Nothing to be done for 'all'. make[2]: Leaving directory '/libxcam/xcore' Making all in clx_kernel make[2]: Entering directory '/libxcam/clx_kernel' make[2]: Nothing to be done for 'all'. make[2]: Leaving directory '/libxcam/clx_kernel' Making all in modules make[2]: Entering directory '/libxcam/modules' Making all in ocl make[3]: Entering directory '/libxcam/modules/ocl' make[3]: Nothing to be done for 'all'. make[3]: Leaving directory '/libxcam/modules/ocl' make[3]: Entering directory '/libxcam/modules' make[3]: Nothing to be done for 'all-am'. make[3]: Leaving directory '/libxcam/modules' make[2]: Leaving directory '/libxcam/modules' Making all in plugins make[2]: Entering directory '/libxcam/plugins' make[3]: Entering directory '/libxcam/plugins' make[3]: Nothing to be done for 'all-am'. make[3]: Leaving directory '/libxcam/plugins' make[2]: Leaving directory '/libxcam/plugins' Making all in wrapper make[2]: Entering directory '/libxcam/wrapper' make[3]: Entering directory '/libxcam/wrapper' make[3]: Nothing to be done for 'all-am'. make[3]: Leaving directory '/libxcam/wrapper' make[2]: Leaving directory '/libxcam/wrapper' Making all in capi make[2]: Entering directory '/libxcam/capi' make[2]: Nothing to be done for 'all'. make[2]: Leaving directory '/libxcam/capi' Making all in tests make[2]: Entering directory '/libxcam/tests' /bin/bash ../libtool --tag=CXX --mode=link g++ -fPIC -DSTDC99 -W -Wall -D_REENTRANT -Wformat -Wformat-security -fstack-protector -g -DDEBUG -std=c++0x -I/usr/include/libdrm -ldrm -I../ext/atomisp -I../xcore -I../modules -g -O2 -o test-device-manager test_device_manager-test-device-manager.o ../xcore/libxcam_core.la ../modules/ocl/libxcam_ocl.la libtool: link: g++ -fPIC -DSTDC99 -W -Wall -D_REENTRANT -Wformat -Wformat-security -fstack-protector -g -DDEBUG -std=c++0x -I/usr/include/libdrm -I../ext/atomisp -I../xcore -I../modules -g -O2 -o .libs/test-device-manager test_device_manager-test-device-manager.o -ldrm ../xcore/.libs/libxcam_core.so ../modules/ocl/.libs/libxcam_ocl.so -pthread -Wl,-rpath -Wl,/usr/local/lib/beignet/lib ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clCreateCommandQueueWithProperties@OPENCL_2.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclGetDeviceIDs@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clReleaseCommandQueue@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclBuildProgram@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clGetExtensionFunctionAddressForPlatform@OPENCL_1.2' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclCreateKernel@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clGetPlatformIDs@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclSetKernelArg@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clCreateProgramWithBinary@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclGetPlatformInfo@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clGetProgramInfo@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclCreateBuffer@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clReleaseProgram@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclSetEventCallback@OPENCL_1.1' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clReleaseEvent@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclEnqueueReadBuffer@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clCreateContext@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclCreateImage@OPENCL_1.2' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clWaitForEvents@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclEnqueueMapImage@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clEnqueueWriteBuffer@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclFinish@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clGetProgramBuildInfo@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclGetEventInfo@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clReleaseContext@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclEnqueueUnmapMemObject@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clGetDeviceInfo@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclEnqueueNDRangeKernel@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clCreateProgramWithSource@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclGetImageInfo@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clReleaseKernel@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclReleaseMemObject@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to clFlush@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference toclGetMemObjectInfo@OPENCL_1.0' ../modules/ocl/.libs/libxcam_ocl.so: undefined reference to `clEnqueueMapBuffer@OPENCL_1.0' collect2: error: ld returned 1 exit status Makefile:541: recipe for target 'test-device-manager' failed make[2]: [test-device-manager] Error 1 make[2]: Leaving directory '/libxcam/tests' Makefile:436: recipe for target 'all-recursive' failed make[1]: [all-recursive] Error 1 make[1]: Leaving directory '/libxcam' Makefile:368: recipe for target 'all' failed make: *** [all] Error 2

windyuan commented 7 years ago

I see /usr/local/cuda-8.0/lib64/libOpenCL.so.1. currently libxcam doens't support nvidia, though we'are trying to make libxcam common without HW dependencies.
Make sure ocl-icd-dev, ocl-icd-opencl-dev installed. also check whether beignet path is in /etc/OpenCL/vendors

lenovoivc commented 7 years ago

Thank you, Yuan! Confirm that: 1) ocl-icd-dev and ocl-icd-opencl-dev have already been installed. 2) In /etc/OpenCL/vendors, there has been a file named intel-beignet.icd, which contains a single line of "/usr/local/lib/beignet//libcl.so"

Moreover, libOpenCL.so locates both at /usr/local/cuda-8.0/lib64 and /usr/lib/x86_64-linux-gnu

How can I get rid of dependency on CUDA?

windyuan commented 7 years ago

I think cuda also has a ICD file in /etc/OpenCL/vendors. you can $ export OCL_ICD_VENDORS=/etc/OpenCL/vendors/intel-beignet.icd or move cuda icd to somewhere(backup the file first) else, then try again.

lenovoivc commented 7 years ago

Successfully made libxcam after removing CUDA path from LD_LIBRARY_PATH However, the erros below still exist when calling test-cl-image X server found. dri2 connection failed! DRM_IOCTL_I915_GEM_APERTURE failed: Invalid argument Assuming 131072kB available aperture size. May lead to reduced performance or incorrect rendering. get chip id failed: -1 [22] param: 4, val: 0 cl_get_gt_device(): error, unknown device: 0 XCAM WARNING cl_device.cpp:113: get cl device ID failed XCAM WARNING cl_device.cpp:52: CL device init failed XCAM DEBUG cl_device.cpp:54: CL device constructed lt-test-cl-image: cl_kernel.cpp:39: XCam::CLKernel::CLKernel(const XCam::SmartPtrXCam::CLContext&, const char*): Assertion `context.ptr ()' failed. Aborted (core dumped)

windyuan commented 7 years ago

you may need to change to 'root' to test or stop service gdm/lightdm. libxcam use libdrm for buffer-management and it's possible the request of buffer-manager failed in authentication with XServer. X server found. dri2 connection failed!

lenovoivc commented 7 years ago

Shut down lightdm in command line mode by sudo servie ligthtdm stop and then called sudo ./test-cl-image -t retinex -f RGBA -i ./input.png -o ./output.png got error below:

DRM_IOCTL_I915_GEM_APERTURE failed: Invalid argument Assuming 131072kB available aperture size. May lead to reduced performance or incorrect rendering. get chip id failed: -1 [22] param: 4, val: 0 beignet-opencl-icd: no supported GPU found, this is probably the wrong opencl-icd package for this hardware (If you have multiple ICDs installed and OpenCL works, you can ignore this message)

windyuan commented 7 years ago

It's more like Beignet doens't support your HW. you can get Beignet code, and there's a script 'GetGenID.sh' which you can run to see your platform. Beignet supports (cat GetGenID.sh)

    #IVB
    genpciid=(0152 0162 0156 0166 015a 016a)
    #BYT
    genpciid+=(0f31)
    #HSW
    genpciid+=(0402 0412 0422 040a 041a 042a 0406 0416 0426 040b 041b 042b 040e 041e 042e)
    genpciid+=(0c02 0c12 0c22 0c0a 0c1a 0c2a 0c06 0c16 0c26 0c0b 0c1b 0c2b 0c0e 0c1e 0c2e)
    genpciid+=(0a02 0a12 0a22 0a0a 0a1a 0a2a 0a06 0a16 0a26 0a0b 0a1b 0a2b 0a0e 0a1e 0a2e)
    genpciid+=(0d02 0d12 0d22 0d0a 0d1a 0d2a 0d06 0d16 0d26 0d0b 0d1b 0d2b 0d0e 0d1e 0d2e)
    #BRW
    genpciid+=(1602 1606 160a 160d 160e 1612 1616 161a 161d 161e 1622 1626 162a 162d 162e)
    #BSW
    genpciid+=(22b0 22b1 22b2 22b3)
    #SKL
    genpciid+=(1906 1916 1926 190e 191e 1902 1912 1932 190b 191b 192b 193b 190a 191a 192a 193a)
    #BXT
    genpciid+=(5a84)
    pciid=($(lspci -nn | grep "\[8086:.*\]" -o | awk -F : '{print $2}' | awk -F ] '{print $1}'))
windyuan commented 7 years ago

BTW, ./test-cl-image -t retinex -f RGBA -i ./input.png -o ./output.png. currently most features' supported format is NV12. you can use ffmpeg or gstreamer change to NV12 format for input. and ouput is same. if you image is not 1080P, you need add -W -H to specify width/height. e.g. ./test-cl-image -t retinex -f NV12 -i ./input.nv12 -o ./output.nv12 -W 1920 -H 1080

lenovoivc commented 7 years ago

What a platform is required? Got nothing when running GetGenID.sh in my PC. I changed format and ran ./test-cl-image -t retinex -f NV12 -i ./input.nv -o ./output.nv -W 512 -H 512 but still the same error: DRM_IOCTL_I915_GEM_APERTURE failed: Invalid argument Assuming 131072kB available aperture size. May lead to reduced performance or incorrect rendering. get chip id failed: -1 [22] param: 4, val: 0 beignet-opencl-icd: no supported GPU found, this is probably the wrong opencl-icd package for this hardware (If you have multiple ICDs installed and OpenCL works, you can ignore this message)

windyuan commented 7 years ago

what's your platform? from Beignet GetGenID.sh. we can see it supports IVB, BYT, HSW, BRW, BSW, SKL, BXT(APL)

lenovoivc commented 7 years ago

My two PCs with pciid of 191f and 0e00 both seem not to be supported in the list of GetGenID.sh. May I manually generate ID for my PCs? Or, I will have to try more PCs.

windyuan commented 7 years ago

I'm not sure your platform from codeid. If you are sure you have another PC with any of IVB, BYT, HSW, BRW, BSW, SKL, BXT(APL). please try again. I also suggest you to drop a mail to beignet mailing list(beignet@lists.freedesktop.org), maybe your pc can be supported but they didn't add the code into beignet.

lenovoivc commented 7 years ago

Tried more than 5 PCs, but they are all not supported. And sent my problem to beignet@lists.freedesktop.org If possible, a list of supported PC modes could be given at the webpage. IVB, BYT, HSW ... look too professional to me, a non-Intel person.

windyuan commented 7 years ago

@lenovoivc sorry for inconvenience, we are planning to add more drivers support in next release.

lenovoivc commented 7 years ago

Thank you. Hope to test libxcam in my PCs soon. BTW: pciid seems related to I/O rather than chip. If testing on local images instead of camera, do I/O drivers matter?

windyuan commented 7 years ago

here is what lspci -nn showed on my PC with Intel integrated graphics controller. Beignet is an OCL driver based on Intel integrated graphics card (chip). 00:02.0 VGA compatible controller [0300]: Intel Corporation 4th Gen Core Processor Integrated Graphics Controller [8086:0416] (rev 06) libxcam is independent from camera. and processed by GPU via OpenCL. The result is same either on camera or on local image.