Update to 1.0.8 - Githubissues

mschwan-phytec commented 5 years ago

Hi!

Are there any plans on updating this layer to version 1.0.8? I tried doing this myself and wanted to open a pull request but I encountered several issues:

The download for the .tar.gz of version 1.0.8 does not exist: https://github.com/Azure/azure-iotedge/releases/download/1.0.8/iotedge-1.0.8.tar.gz Which got me wondering why there is a separate repository containing releases for iotedge? Is it because 1.0.8 is not GA at the moment?
Using the tagged commit from the upstream branch release/1.0.8 does not work for some reason. Yocto claims that the commit in this branch does not exist, though it is available. Even specifying the master branch with the commit ID (https://github.com/Azure/iotedge/commit/f5186c42ebb721893c5a497c789236803de42fb7 or https://github.com/Azure/iotedge/commit/208b2204fd30e856d00b280112422130c104b9f0) does not work.

Can you provide any information on this?

wlenzeder commented 5 years ago

Hi, when will this layer be updated to 1.0.8 - I've seen that 1.0.9-rc1 has been released, will 1.0.8 be skipped for meta-iotedge? There are also Yocto build issues with version 1.0.7 and the current rust/cargo versions in the master branch of meta-rust.

myagley commented 5 years ago

I just pushed an update for 1.0.8 on the sumo and thud branches. I'll look at adding warrior soon.

mschwan-phytec commented 5 years ago

Thank you!

wlenzeder commented 5 years ago

Hi, thanks for pushing the update!

I tried building the new version for sumo, but unfortunately I'm having issues during compilation:

[ 69%] Built target hsm_client_tpm_ut_exe
Makefile:162: recipe for target 'all' failed

--- stderr
CMake Warning:
  Manually-specified variables were not used by the project:

    use_emulator

/nStack/devLicense/share/yocto/build/tmp/work/cortexa7hf-neon-poky-linux-gnueabi/iotedge-cli/1.0.8-r0/recipe-sysroot-native/usr/lib/libssl.so: file not recognized: File format not recognized
collect2: error: ld returned 1 exit status
make[2]: *** [libiothsm.so.1.0.8] Error 1
make[1]: *** [CMakeFiles/iothsm.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
make: *** [all] Error 2
thread 'main' panicked at '
command did not execute successfully, got: exit code: 2

The full compile log file is attached: log.do_compile.zip

SSL libary info:

libssl.so -> libssl.so.1.0.2: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, BuildID[sha1]=7b162aad9ee22c5a3f2516670fd2965cfa4cdc0d, stripped

Build Configuration (excerpt):

BUILD_SYS            = "x86_64-linux"
TARGET_SYS           = "arm-poky-linux-gnueabi"
TUNE_FEATURES        = "arm armv7ve vfp thumb neon callconvention-hard cortexa7"
TARGET_FPU           = "hard"

Could you please have a look?

Thanks, Wolfgang

mschwan-phytec commented 5 years ago

Can confirm that sumo does not build, but thud does.

myagley commented 5 years ago

Are you on the sumo branch`?

wlenzeder commented 5 years ago

I'm on the most recent sumo branches:

Build Configuration:
BB_VERSION           = "1.38.0"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "arm-poky-linux-gnueabi"
...
TUNE_FEATURES        = "arm armv7ve vfp thumb neon callconvention-hard cortexa7"
TARGET_FPU           = "hard"
meta
meta-poky            = "sumo:5ddf7fff992b065ee512878d2fe65f3e35d818cf"
meta-oe              = "sumo:8760facba1bceb299b3613b8955621ddaa3d4c3f"
...
meta-virtualization  = "sumo:ed2038c935777d1336c17989d454f4e9c95fea7f"
meta-rust            = "master:11aed43748d7dd194dc6c06a35a16104400d1090"
meta-iotedge         = "sumo:734dc718da4fe3ac39b6049f543223698897433f"

ksaye commented 5 years ago

I get the same error:

ksaye@el1000:~/rpi$ bitbake core-image-base

Build Configuration: BB_VERSION = "1.38.0" BUILD_SYS = "x86_64-linux" NATIVELSBSTRING = "universal" TARGET_SYS = "aarch64-poky-linux" MACHINE = "raspberrypi3-64" DISTRO = "poky" DISTRO_VERSION = "2.5.3" TUNE_FEATURES = "aarch64" TARGET_FPU = "" meta meta-poky meta-yocto-bsp = "sumo:5ddf7fff992b065ee512878d2fe65f3e35d818cf" meta-oe meta-networking meta-python meta-filesystems = "sumo:8760facba1bceb299b3613b8955621ddaa3d4c3f" meta-raspberrypi = "sumo:2d40b000021bc8a9ef7f329ed0ad410f8d227b97" meta-iotedge = "sumo:734dc718da4fe3ac39b6049f543223698897433f" meta-rust = "HEAD:9487b089ea4779c2b494b17b9254219226efa539" meta-virtualization = "sumo:ed2038c935777d1336c17989d454f4e9c95fea7f"

I get the error shown below:

[ 64%] Linking C shared library libiothsm.so	CMakeFiles/iothsm.dir/build.make:543: recipe for target 'libiothsm.so.1.0.8' failed	CMakeFiles/Makefile2:68: recipe for target 'CMakeFiles/iothsm.dir/all' failed	[ 65%] Linking C executable edge_openssl_enc_ut_exe	[ 65%] Built target edge_openssl_enc_ut_exe	[ 66%] Linking C executable edge_hsm_key_intf_sas_ut_exe	[ 66%] Built target edge_hsm_key_intf_sas_ut_exe	[ 66%] Linking C executable edge_hsm_tpm_ut_exe	[ 66%] Built target edge_hsm_tpm_ut_exe	[ 66%] Linking C executable edge_hsm_crypto_ut_exe	[ 66%] Built target edge_hsm_crypto_ut_exe	[ 67%] Linking C executable edge_hsm_x509_ut_exe	[ 67%] Built target edge_hsm_x509_ut_exe	[ 68%] Linking C executable edge_openssl_pki_ut_exe	[ 68%] Built target edge_openssl_pki_ut_exe	[ 69%] Linking C executable hsm_client_tpm_ut_exe	[ 69%] Built target hsm_client_tpm_ut_exe	Makefile:162: recipe for target 'all' failed
--- stderr
fatal: not a git repository (or any of the parent directories): .git
CMake Warning:
Manually-specified variables were not used by the project:
use_emulator
/home/ksaye/rpi/rpi-build/tmp/work/aarch64-poky-linux/iotedge-cli/1.0.8-r0/recipe-sysroot-native/usr/lib/libssl.so: error adding symbols: File in wrong format
collect2: error: ld returned 1 exit status
make[2]: *** [libiothsm.so.1.0.8] Error 1
make[1]: *** [CMakeFiles/iothsm.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
make: *** [all] Error 2
thread 'main' panicked at '
command did not execute successfully, got: exit code: 2

Looking in the 'rpi-build/tmp/work/aarch64-poky-linux/iotedge-cli/1.0.8-r0/recipe-sysroot-native/usr/lib' I do not see libssl.so.1.0.8, which I guess is the problem.

ksaye@el1000:~/rpi/rpi-build/tmp/work/aarch64-poky-linux/iotedge-cli/1.0.8-r0/recipe-sysroot-native/usr/lib$ ls -all libssl. -rw-r--r-- 440 ksaye ksaye 730666 Feb 3 2019 libssl.a lrwxrwxrwx 1 ksaye ksaye 15 Oct 25 18:45 libssl.so -> libssl.so.1.0.2 -rwxr-xr-x 440 ksaye ksaye 437408 Feb 3 2019 libssl.so.1.0.2 ksaye@el1000:~/rpi/rpi-build/tmp/work/aarch64-poky-linux/iotedge-cli/1.0.8-r0/recipe-sysroot-native/usr/lib$

emilm commented 4 years ago

Did anyone solve this? I tried to add 1.0.9 RC3 in my own meta-layer for now but I run into the same error. I see that you compile for ARM. It might take an x86 libssl.so and try to link it with ARM libiothsm

I found out by doing: objdump -f ..../build/tmp-glibc/work/armv5-oe-linux-gnueabi/iotedge-cli/1.0.9-r0/recipe-sysroot-native/usr/lib/libssl.a | grep arch

prints: architecture: i386:x86-64, flags 0x00000011:

emilm commented 4 years ago

iotedge-cli does not have the necessary OpenSSL dirs specified to staging dir

https://github.com/Azure/meta-iotedge/blob/sumo/recipes-core/iotedge-cli/iotedge-cli.inc

Needs:

export OPENSSL_DIR = "${STAGING_EXECPREFIXDIR}" export OpenSSLDir = "${STAGING_EXECPREFIXDIR}" export OPENSSL_ROOT_DIR = "${STAGING_EXECPREFIXDIR}"

and perhaps export LIBIOTHSM_NOBUILD="On" ? @myagley

1st is for openssl-rust (openssl, openssl-sys crates) 2nd is for edgelet/hsm-sys/azure-iot-hsm-c/deps/c-shared/CMakeLists.txt 3rd is for edgelet/hsm-sys/azure-iot-hsm-c/CMakeLists.txt

I have successfully built 1.0.9 RC3 now for warrior 👍

wlenzeder commented 4 years ago

I can confirm that build for Yocto Sumo is fixed by #35

vaishnavils97 commented 3 years ago

I am facing same issue while building a yocto image for raspberry pi Model B. I am referring this link for the build "https://kevinsaye.wordpress.com/2019/06/21/how-to-build-a-yocto-image-for-the-raspberry-pi-running-azure-iot-edge/" . Have cloned meta-iotedge sumo branch and got the below error

/home/YoctoLinux/rpi/rpi-build/tmp/work/cortexa7hf-neon-vfpv4-poky-linux-gnueabi/iotedge-cli/1.0.8-r0/recipe-sysroot-native/usr/lib/libssl.so: file not recognized: File format not recognized	collect2: error: ld returned 1 exit status	make[2]: *** [libiothsm.so.1.0.8] Error 1	make[1]: *** [CMakeFiles/iothsm.dir/all] Error 2	make[1]: *** Waiting for unfinished jobs....	make: *** [all] Error 2	thread 'main' panicked at '	command did not execute successfully, got: exit code: 2
build script failed, must exit now', /home/YoctoLinux/rpi/rpi-build/tmp/work/cortexa7hf-neon-vfpv4-poky-linux-gnueabi/iotedge-cli/1.0.8-r0/cargo_home/bitbake/cmake-0.1.30/src/lib.rs:643:5

Please give inputs to solve the issue

vaishnavils97 commented 3 years ago

I have updated the file < https://github.com/Azure/meta-iotedge/blob/sumo/recipes-core/iotedge-cli/iotedge-cli.inc>

export OPENSSL_DIR = "${STAGING_EXECPREFIXDIR}" export OpenSSLDir = "${STAGING_EXECPREFIXDIR}" export OPENSSL_ROOT_DIR = "${STAGING_EXECPREFIXDIR}"

and perhaps export LIBIOTHSM_NOBUILD="On"

But not resolving issue. Please let me know if any solution available

XIIIVI commented 3 years ago

Hi all,

I have also the same issue when compiling the tool tpm_device_provision of the azure-iot-sdk-c in Yocto. I tried to add the following lines to the recipe without any success

DEPENDS += "openssl virtual/libiothsm"
RDEPENDS_${PN} += "virtual/libiothsm"

export OPENSSL_DIR = "${STAGING_EXECPREFIXDIR}"
export LIBIOTHSM_NOBUILD="On"
INHIBIT_PACKAGE_STRIP = "1"

The last line comes from this post.

I'm using the branch "dunfell". I've spent over a week on this issue and I'm desesperately interesting in any clue to solve it ;)

Have a nice WE

XIIIVI commented 3 years ago

After an ultimate try, my recipe managed to compile. The settings are the following

DEPENDS += "openssl"

export OPENSSL_DIR = "${STAGING_EXECPREFIXDIR}"
export OpenSSLDir = "${STAGING_EXECPREFIXDIR}"
export OPENSSL_ROOT_DIR = "${STAGING_EXECPREFIXDIR}"
export LIBIOTHSM_NOBUILD="On"

Have a nice WE

micahl commented 3 years ago

Cool, thanks for the update, @XIIIVI! Closing

Azure / meta-iotedge

Update to 1.0.8 #22