search

PelionIoT / simple-mbed-cloud-client

Simple interface for Mbed Cloud Client - deprecated
Apache License 2.0
7 stars 21 forks source link

Support production mode #54

Closed micgur01 closed 5 years ago

MarceloSalazar commented 5 years ago

@micgur01 thanks for the PR! Can you please edit the comment section of the PR and add more information what's being added and details on the enhancement?

Also, I see many changes on this PR. Are all of them required?

Have you tested this on a platform? If so, can you share the results of the tests? (see https://github.com/ARMmbed/simple-mbed-cloud-client#testing)

micgur01 commented 5 years ago

file simple-mbed-cloud-client.cpp

  1. removed some unnecessary includes
  2. put "update_client_hub.h" under DEV flag
  3. ARM_UC_SetVendorId should be set only for development mode as well

storage_helper has to be changed as Factory Configuration Client Example uses partition mode we have to support it here or changed the FCCE behavior.

file storage_helper.h mcc_platform_storage_size moved into the class and put under MCC_PLATFORM_PARTITION_MODE ==1 it's used only for partition mode same for create_partitions(void); function

It was passed compilation in case MCC_PLATFORM_PARTITION_MODE mode enabled

file storage_helper.cpp

has to be initialize - fs1(NULL), fs2(NULL), part1(NULL), part2(NULL) The code moved to be C++, but it was never compiled and used for partition mode Using same code as Mbed Clound Client Example , changes are for C++ only has to use class members, _bd and create_partitions

micgur01 commented 5 years ago

I've tested on K64F, L429ZI and F496ZG target All connected to Cloud on both development and production mode Changes has to be aligned with mbed_app.json from this pull request https://github.com/ARMmbed/simple-mbed-cloud-client-template-restricted/pull/44

MarceloSalazar commented 5 years ago

Can you share the tests results when using mbed test ... please? https://github.com/ARMmbed/simple-mbed-cloud-client#testing

micgur01 commented 5 years ago

I did not run tests yet, going to run it now never done it before, trying to find out easiest way to do so

screamerbg commented 5 years ago

@micgur01 You could try to import the https://github.com/ARMmbed/pelion-enablement repository, which has configuration for many of the currently supported platforms.

micgur01 commented 5 years ago

It's not correct to format before storage init, it could be used partition mode in case of problem it formats the correct partition ( if failed to verify_cloud_configuration) merged the last changes and run tests , results below mbedgt: all tests finished! mbedgt: shuffle seed: 0.4297118341 mbedgt: test suite report: +--------------+---------------+------------------------------+--------+--------------------+-------------+ | target | platform_name | test suite | result | elapsed_time (sec) | copy_method | +--------------+---------------+------------------------------+--------+--------------------+-------------+ | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | OK | 133.17 | default | +--------------+---------------+------------------------------+--------+--------------------+-------------+ mbedgt: test suite results: 1 OK mbedgt: test case report: +--------------+---------------+------------------------------+----------------------------+--------+--------+--------+--------------------+ | target | platform_name | test suite | test case | passed | failed | result | elapsed_time (sec) | +--------------+---------------+------------------------------+----------------------------+--------+--------+--------+--------------------+ | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Connect to Network | 1 | 0 | OK | 6.55 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Consistent Identity | 1 | 0 | OK | 2.12 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Initialize Storage | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | LwM2M GET Test | 1 | 0 | OK | 1.14 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | LwM2M POST Test | 1 | 0 | OK | 0.67 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | LwM2M PUT Test | 1 | 0 | OK | 0.82 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | LwM2M SET Test | 1 | 0 | OK | 0.45 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Pelion DM Bootstrap & Reg. | 1 | 0 | OK | 12.17 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Pelion DM Directory | 1 | 0 | OK | 6.29 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Pelion DM Re-register | 1 | 0 | OK | 4.96 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Simple PDMC Initialization | 1 | 0 | OK | 17.81 | +--------------+---------------+------------------------------+----------------------------+--------+--------+--------+--------------------+ mbedgt: test case results: 10 OK / 1 ERROR mbedgt: completed in 139.33 sec

micgur01 commented 5 years ago

All tested passed, consistently

| target | platform_name | test suite | test case | passed | failed | result | elapsed_time (sec) | +--------------+---------------+------------------------------+----------------------------+--------+--------+--------+--------------------+ | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Connect to Network | 1 | 0 | OK | 7.05 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Consistent Identity | 1 | 0 | OK | 2.12 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Initialize Storage | 1 | 0 | OK | 0.04 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | LwM2M GET Test | 1 | 0 | OK | 1.06 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | LwM2M POST Test | 1 | 0 | OK | 0.66 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | LwM2M PUT Test | 1 | 0 | OK | 0.93 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | LwM2M SET Test | 1 | 0 | OK | 0.54 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Pelion DM Bootstrap & Reg. | 1 | 0 | OK | 11.69 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Pelion DM Directory | 1 | 0 | OK | 6.01 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Pelion DM Re-register | 1 | 0 | OK | 4.91 | | K64F-GCC_ARM | K64F | spdmc-tests-dev_mgmt-connect | Simple PDMC Initialization | 1 | 0 | OK | 17.8 | +--------------+---------------+------------------------------+----------------------------+--------+--------+--------+--------------------+ mbedgt: test case results: 11 OK mbedgt: completed in 141.13 sec

micgur01 commented 5 years ago

Format storage only at test start, this is also doesn't rude the regular flow Maybe create a new pull request with all changes at once, it would be easier for you?

micgur01 commented 5 years ago

Rebased and update test according to production flow both connect and update tests. all tests related to connect and update passed, some tests failed with strange error and last 0 sec looks like it doesn't really run, but not related to my changes Running latest simple-mbed-cloud-client get the same errors...

| K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet 128 buffer | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet 256 buffer | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet 1024 buffer | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet 4096 buffer | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet network setup | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-threaded | Ethernet 1 thread | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-threaded | Ethernet 2 threads | 0 | 0 | ERROR | 0.0

here the results: +--------------+---------------+----------------------------------------------------+--------+--------------------+-------------+ | target | platform_name | test suite | result | elapsed_time (sec) | copy_method | +--------------+---------------+----------------------------------------------------+--------+--------------------+-------------+ | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | OK | 5525.1 | default | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-threaded | OK | 123.49 | default | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | OK | 78.83 | default | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-threaded | OK | 56.53 | default | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-stress-net-fs | OK | 106.61 | default | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK | 129.9 | default | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | OK | 257.44 | default | +--------------+---------------+----------------------------------------------------+--------+--------------------+-------------+ mbedgt: test suite results: 7 OK mbedgt: test case report: +--------------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+--------+--------------------+ | target | platform_name | test suite | test case | passed | failed | result | elapsed_time (sec) | +--------------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+--------+--------------------+ | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | SD+FAT 1 file, buff 1 | 1 | 0 | OK | 18.07 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | SD+FAT 1 file, buff 4 | 1 | 0 | OK | 18.19 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | SD+FAT 1 file, buff 16 | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | SD+FAT 1 file, buff 64 | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | SD+FAT 1 file, buff 256 | 1 | 0 | OK | 17.91 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | SD+FAT 1 file, buff 1024 | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | SD+FAT 1 file, buff 4096 | 1 | 0 | OK | 17.52 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | SD+FAT 1 file, buff 16384 | 1 | 0 | OK | 17.97 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-single | SD+FAT format | 1 | 0 | OK | 0.13 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-threaded | SD+FAT 2 files, buff 4b/256b | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-threaded | SD+FAT 3 files, buff 256b/1kb/4kb | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-fs-threaded | SD+FAT format | 1 | 0 | OK | 0.09 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet 128 buffer | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet 256 buffer | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet 1024 buffer | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet 4096 buffer | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-single | Ethernet network setup | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-threaded | Ethernet 1 thread | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-threaded | Ethernet 2 threads | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-net-threaded | Ethernet network setup | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-stress-net-fs | Ethernet network setup | 1 | 0 | OK | 7.01 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT format | 1 | 0 | OK | 0.08 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 1 thread, dl, file seq. | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 2 threads, dl, 1kb | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 3 threads, dl, 256b, 1kb | 0 | 0 | ERROR | 0.0 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Connect to Ethernet | 2 | 0 | OK | 7.05 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Initialize Simple PDMC | 2 | 0 | OK | 17.86 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Initialize Storage | 1 | 0 | OK | 0.05 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Pelion Bootstrap & Reg. | 1 | 0 | OK | 15.49 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Pelion Directory | 1 | 0 | OK | 0.95 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Pelion Re-register | 1 | 0 | OK | 5.25 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Post-reset Identity | 1 | 0 | OK | 0.11 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Resource LwM2M GET | 1 | 0 | OK | 6.33 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Resource LwM2M POST | 1 | 0 | OK | 0.67 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Resource LwM2M PUT | 1 | 0 | OK | 0.9 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-connect | Resource LwM2M SET | 1 | 0 | OK | 0.43 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Connect to Ethernet | 2 | 0 | OK | 5.05 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Initialize Simple PDMC | 2 | 0 | OK | 17.85 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Initialize Storage | 1 | 0 | OK | 0.05 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Pelion Bootstrap & Reg. | 1 | 0 | OK | 15.83 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Pelion Directory | 1 | 0 | OK | 1.2 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Pelion Firmware Download | 1 | 0 | OK | 108.61 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Pelion Firmware Prepare | 1 | 0 | OK | 0.86 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Pelion Firmware Update | 1 | 0 | OK | 31.67 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Pelion Re-register | 1 | 0 | OK | 5.29 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Post-update Erase | 1 | 0 | OK | 0.01 | | K64F-GCC_ARM | K64F | simple-mbed-cloud-client-tests-dev_mgmt-update | Post-update Identity | 1 | 0 | OK | 0.1 | +--------------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+--------+--------------------+ mbedgt: test case results: 31 OK / 16 ERROR mbedgt: completed in 6321.77 sec

screamerbg commented 5 years ago

As I already pointed in the comments, the garbage on the filesystem causes the client to fail to initialize. Here's the preliminary test summary for few targets. I'll attach the test logs shortly.

[2018-12-05 20:52:28] INFO:  --------------------------------- 
[2018-12-05 20:52:28] INFO:          TEST RUNNER LOG         
[2018-12-05 20:52:28] INFO:  --------------------------------- 
[2018-12-05 20:52:28] INFO: PLATFORM: NUMAKER_PFM_M487
[2018-12-05 20:52:28] INFO: PLATFORM: K66F
[2018-12-05 20:52:28] INFO: PLATFORM: NUCLEO_F429ZI
[2018-12-05 20:52:28] INFO: PLATFORM: MTB_USI_WM_BN_BM_22
[2018-12-05 20:52:28] INFO: PLATFORM: NUCLEO_F767ZI
[2018-12-05 20:52:28] INFO: PLATFORM: DISCO_L475VG_IOT01A
[2018-12-05 20:52:28] INFO: PLATFORM: UBLOX_EVK_ODIN_W2
[2018-12-05 20:52:28] INFO: PLATFORM: DISCO_F413ZH
[2018-12-05 20:52:28] INFO: PLATFORM: NUCLEO_F746ZG
[2018-12-05 20:52:28] INFO: PLATFORM: NUMAKER_IOT_M487
[2018-12-05 20:52:28] INFO: PLATFORM: UBLOX_C030_U201
[2018-12-05 20:52:28] INFO: PLATFORM: K64F
[2018-12-05 20:52:28] INFO: PLATFORM: MTB_MXCHIP_EMW3166
[2018-12-05 20:52:28] INFO: PLATFORM: NUMAKER_PFM_NUC472
[2018-12-05 20:52:28] INFO: TOOLCHAIN: ARM
[2018-12-05 20:52:28] INFO: PATH: D:\mbed\pelion-enablement
[2018-12-05 20:52:28] INFO: RESULTS DIR: TEST_OUTPUT
[2018-12-05 20:52:28] INFO: MBED OS HASH: e0c32da4c8ab4763770560b7eb98e5bc5e876dbc
[2018-12-05 20:52:28] INFO: PARAMETERS: -n simple-mbed-cloud-client-tests* -v
[2018-12-05 20:52:28] INFO: -----------------------------------
[2018-12-05 20:52:28] INFO: TEST STARTED...
[2018-12-05 21:00:11] INFO: EXEC: "mbed test --compile -t ARM -m NUMAKER_PFM_M487 -n simple-mbed-cloud-client-tests* -v" (code: 0)
None
[2018-12-05 21:00:11] ERROR: FAILED: "mbed test --run -t ARM -m NUMAKER_PFM_M487 --report-json TEST_OUTPUT\e0c32da4c8ab4763770560b7eb98e5bc5e876dbc\2018-12-05 20-52-28/NUMAKER_PFM_M487_ARM_results.json -n simple-mbed-cloud-client-tests* -v" (code: 2)
None
[2018-12-05 21:00:11] INFO: TEST RESULTS

+----------------------+------------------+----------------------------------------------------+--------------------------------------------+--------+--------+---------+-------+
| target               | platform_name    | test suite                                         | test case                                  | passed | failed | result  |  time |
+----------------------+------------------+----------------------------------------------------+--------------------------------------------+--------+--------+---------+-------+
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet   128 buffer                      | 1      | 0      | OK      |  9.23 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet   256 buffer                      | 1      | 0      | OK      |  9.38 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet  1024 buffer                      | 1      | 0      | OK      |   5.5 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet  4096 buffer                      | 1      | 0      | OK      |  1.86 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet network setup                     | 1      | 0      | OK      |  4.01 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-single    | ----- TOTAL -----                          | 5      | 0      | OK      | 63.68 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-stress-net-fs | Ethernet network setup                     | 1      | 0      | OK      |  4.01 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-stress-net-fs | NUSD+FAT format                            | 1      | 0      | OK      |  0.02 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-stress-net-fs | NUSD+FAT+Ethernet 1 thread, dl, file seq.  | 1      | 0      | OK      |  5.52 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-stress-net-fs | NUSD+FAT+Ethernet 2 threads, dl, 1kb       | 1      | 0      | OK      |  8.29 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-stress-net-fs | NUSD+FAT+Ethernet 3 threads, dl, 256b, 1kb | 1      | 0      | OK      | 13.35 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-stress-net-fs | ----- TOTAL -----                          | 5      | 0      | OK      | 65.65 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet 1 thread                          | 1      | 0      | OK      |  4.82 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet 2 threads                         | 1      | 0      | OK      |  4.24 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet network setup                     | 1      | 0      | OK      |  3.89 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-net-threaded  | ----- TOTAL -----                          | 3      | 0      | OK      | 46.68 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-threaded   | NUSD+FAT 2 files, buff 4b/256b             | 1      | 0      | OK      |  5.61 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-threaded   | NUSD+FAT 3 files, buff 256b/1kb/4kb        | 1      | 0      | OK      |   8.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-threaded   | NUSD+FAT format                            | 1      | 0      | OK      |  0.01 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-threaded   | ----- TOTAL -----                          | 3      | 0      | OK      | 46.04 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Connect to Ethernet                        | 1      | 0      | OK      |  4.55 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Simple PDMC                     | 0      | 1      | FAIL    | 36.05 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Storage                         | 1      | 0      | OK      |  0.03 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Bootstrap & Reg.                    | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Directory                           | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Re-register                         | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Post-reset Identity                        | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M GET                         | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M POST                        | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M PUT                         | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M SET                         | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | ----- TOTAL -----                          | 2      | 1      | FAIL    | 79.27 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | NUSD+FAT 1 file, buff     1                | 1      | 0      | OK      |   5.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | NUSD+FAT 1 file, buff     4                | 1      | 0      | OK      |  3.27 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | NUSD+FAT 1 file, buff    16                | 1      | 0      | OK      |  2.65 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | NUSD+FAT 1 file, buff    64                | 1      | 0      | OK      |  2.61 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | NUSD+FAT 1 file, buff   256                | 1      | 0      | OK      |  2.55 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | NUSD+FAT 1 file, buff  1024                | 1      | 0      | OK      |   2.5 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | NUSD+FAT 1 file, buff  4096                | 1      | 0      | OK      |  2.62 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | NUSD+FAT 1 file, buff 16384                | 1      | 0      | OK      |  2.71 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | NUSD+FAT format                            | 1      | 0      | OK      |  0.02 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-basic-fs-single     | ----- TOTAL -----                          | 9      | 0      | OK      | 56.48 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Connect to Ethernet                        | 1      | 0      | OK      |  4.04 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Simple PDMC                     | 0      | 1      | FAIL    | 35.94 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Storage                         | 1      | 0      | OK      |  0.16 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Bootstrap & Reg.                    | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Directory                           | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Download                   | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Prepare                    | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Update                     | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Re-register                         | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Erase                          | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Identity                       | 0      | 0      | SKIPPED |   0.0 |
| NUMAKER_PFM_M487-ARM | NUMAKER_PFM_M487 | simple-mbed-cloud-client-tests-dev_mgmt-update     | ----- TOTAL -----                          | 2      | 1      | FAIL    | 77.77 |
+----------------------+------------------+----------------------------------------------------+--------------------------------------------+--------+--------+---------+-------+

[2018-12-05 21:10:06] INFO: EXEC: "mbed test --compile -t ARM -m K66F -n simple-mbed-cloud-client-tests* -v" (code: 0)
None
[2018-12-05 21:10:06] ERROR: FAILED: "mbed test --run -t ARM -m K66F --report-json TEST_OUTPUT\e0c32da4c8ab4763770560b7eb98e5bc5e876dbc\2018-12-05 20-52-28/K66F_ARM_results.json -n simple-mbed-cloud-client-tests* -v" (code: 3)
None
[2018-12-05 21:10:06] INFO: TEST RESULTS

+----------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+---------+--------+
| target   | platform_name | test suite                                         | test case                                | passed | failed | result  |   time |
+----------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+---------+--------+
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet   128 buffer                    | 1      | 0      | OK      |   9.36 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet   256 buffer                    | 1      | 0      | OK      |   5.64 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet  1024 buffer                    | 1      | 0      | OK      |   4.95 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet  4096 buffer                    | 1      | 0      | OK      |   1.97 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet network setup                   | 1      | 0      | OK      |   6.01 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-single    | ----- TOTAL -----                        | 5      | 0      | OK      |  57.55 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-stress-net-fs | Ethernet network setup                   | 1      | 0      | OK      |   6.02 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT format                            | 1      | 0      | OK      |   0.07 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 1 thread, dl, file seq.  | 1      | 0      | OK      |   5.71 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 2 threads, dl, 1kb       | 1      | 0      | OK      |  22.41 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 3 threads, dl, 256b, 1kb | 1      | 0      | OK      |   40.3 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-stress-net-fs | ----- TOTAL -----                        | 5      | 0      | OK      |  105.9 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet 1 thread                        | 1      | 0      | OK      |   4.76 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet 2 threads                       | 1      | 0      | OK      |  10.05 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet network setup                   | 1      | 0      | OK      |   6.02 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-net-threaded  | ----- TOTAL -----                        | 3      | 0      | OK      |  50.44 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-threaded   | SD+FAT 2 files, buff 4b/256b             | 1      | 0      | OK      |  35.47 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-threaded   | SD+FAT 3 files, buff 256b/1kb/4kb        | 1      | 0      | OK      |  56.65 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-threaded   | SD+FAT format                            | 1      | 0      | OK      |   0.07 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-threaded   | ----- TOTAL -----                        | 3      | 0      | OK      | 119.55 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Connect to Ethernet                      | 1      | 0      | OK      |   6.04 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Simple PDMC                   | 0      | 1      | FAIL    |  66.28 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Storage                       | 1      | 0      | OK      |   0.03 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Bootstrap & Reg.                  | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Directory                         | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Re-register                       | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Post-reset Identity                      | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M GET                       | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M POST                      | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M PUT                       | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M SET                       | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-connect    | ----- TOTAL -----                        | 2      | 1      | FAIL    | 108.65 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff     1                | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff     4                | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff    16                | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff    64                | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff   256                | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff  1024                | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff  4096                | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff 16384                | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT format                            | 0      | 1      | FAIL    |   0.03 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-basic-fs-single     | ----- TOTAL -----                        | 0      | 1      | FAIL    |  26.84 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Connect to Ethernet                      | 1      | 0      | OK      |   6.06 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Simple PDMC                   | 0      | 1      | FAIL    |  56.21 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Storage                       | 1      | 0      | OK      |   0.04 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Bootstrap & Reg.                  | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Directory                         | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Download                 | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Prepare                  | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Update                   | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Re-register                       | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Erase                        | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Identity                     | 0      | 0      | SKIPPED |    0.0 |
| K66F-ARM | K66F          | simple-mbed-cloud-client-tests-dev_mgmt-update     | ----- TOTAL -----                        | 2      | 1      | FAIL    |  97.84 |
+----------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+---------+--------+

[2018-12-05 21:20:58] INFO: EXEC: "mbed test --compile -t ARM -m NUCLEO_F429ZI -n simple-mbed-cloud-client-tests* -v" (code: 0)
None
[2018-12-05 21:20:58] ERROR: FAILED: "mbed test --run -t ARM -m NUCLEO_F429ZI --report-json TEST_OUTPUT\e0c32da4c8ab4763770560b7eb98e5bc5e876dbc\2018-12-05 20-52-28/NUCLEO_F429ZI_ARM_results.json -n simple-mbed-cloud-client-tests* -v" (code: 3)
None
[2018-12-05 21:20:58] INFO: TEST RESULTS

+-------------------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+---------+--------+
| target            | platform_name | test suite                                         | test case                                | passed | failed | result  |   time |
+-------------------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+---------+--------+
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet   128 buffer                    | 1      | 0      | OK      |   9.25 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet   256 buffer                    | 1      | 0      | OK      |   5.51 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet  1024 buffer                    | 1      | 0      | OK      |   1.89 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet  4096 buffer                    | 1      | 0      | OK      |   1.88 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet network setup                   | 1      | 0      | OK      |   3.01 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-single    | ----- TOTAL -----                        | 5      | 0      | OK      |   44.2 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | Ethernet network setup                   | 1      | 0      | OK      |   3.01 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT format                            | 1      | 0      | OK      |    0.1 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 1 thread, dl, file seq.  | 1      | 0      | OK      |   5.67 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 2 threads, dl, 1kb       | 1      | 0      | OK      |  28.66 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 3 threads, dl, 256b, 1kb | 1      | 0      | OK      |  53.42 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | ----- TOTAL -----                        | 5      | 0      | OK      | 115.29 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet 1 thread                        | 1      | 0      | OK      |   1.91 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet 2 threads                       | 1      | 0      | OK      |   5.83 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet network setup                   | 1      | 0      | OK      |   4.01 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-net-threaded  | ----- TOTAL -----                        | 3      | 0      | OK      |  34.51 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-threaded   | SD+FAT 2 files, buff 4b/256b             | 1      | 0      | OK      |  48.73 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-threaded   | SD+FAT 3 files, buff 256b/1kb/4kb        | 1      | 0      | OK      |  78.52 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-threaded   | SD+FAT format                            | 1      | 0      | OK      |   0.09 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-threaded   | ----- TOTAL -----                        | 3      | 0      | OK      | 149.36 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Connect to Ethernet                      | 1      | 0      | OK      |   3.05 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Simple PDMC                   | 0      | 1      | FAIL    | 114.31 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Storage                       | 1      | 0      | OK      |   0.04 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Bootstrap & Reg.                  | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Directory                         | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Re-register                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Post-reset Identity                      | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M GET                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M POST                      | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M PUT                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M SET                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | ----- TOTAL -----                        | 2      | 1      | FAIL    | 144.47 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff     1                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff     4                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff    16                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff    64                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff   256                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff  1024                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff  4096                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff 16384                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT format                            | 0      | 1      | FAIL    |   0.04 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-basic-fs-single     | ----- TOTAL -----                        | 0      | 1      | FAIL    |  21.89 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Connect to Ethernet                      | 1      | 0      | OK      |   3.04 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Simple PDMC                   | 0      | 1      | FAIL    |  87.11 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Storage                       | 1      | 0      | OK      |   0.05 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Bootstrap & Reg.                  | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Directory                         | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Download                 | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Prepare                  | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Update                   | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Re-register                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Erase                        | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Identity                     | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F429ZI-ARM | NUCLEO_F429ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | ----- TOTAL -----                        | 2      | 1      | FAIL    | 116.89 |
+-------------------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+---------+--------+
screamerbg commented 5 years ago

And here are the detailed logs: K66F_ARM_output.txt NUCLEO_F429ZI_ARM_output.txt NUMAKER_PFM_M487_ARM_output.txt

micgur01 commented 5 years ago

I've got it now, why I had to changed it at first place this code used to format SD before your last changes int storage_status = client.reformat_storage(); I had to change it, but you are not using now client to format file system now only function of file system, so I suppose it should be fine now

screamerbg commented 5 years ago

@micgur01 Can you try to minimize the changes to the tests and rather focus on SMCC? Ideally there should be no impact on the developer application, where the test is also a developer application.

screamerbg commented 5 years ago

@micgur01 Further failures on more targets - see below.

[2018-12-05 21:32:28] INFO: EXEC: "mbed test --compile -t ARM -m MTB_USI_WM_BN_BM_22 -n simple-mbed-cloud-client-tests* -v" (code: 0)
None
[2018-12-05 21:32:28] ERROR: FAILED: "mbed test --run -t ARM -m MTB_USI_WM_BN_BM_22 --report-json TEST_OUTPUT\e0c32da4c8ab4763770560b7eb98e5bc5e876dbc\2018-12-05 20-52-28/MTB_USI_WM_BN_BM_22_ARM_results.json -n simple-mbed-cloud-client-tests* -v" (code: 2)
None
[2018-12-05 21:32:28] INFO: TEST RESULTS

+-------------------------+---------------------+----------------------------------------------------+----------------------------------------+--------+--------+---------+--------+
| target                  | platform_name       | test suite                                         | test case                              | passed | failed | result  |   time |
+-------------------------+---------------------+----------------------------------------------------+----------------------------------------+--------+--------+---------+--------+
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-single    | WiFi   128 buffer                      | 1      | 0      | OK      |   9.38 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-single    | WiFi   256 buffer                      | 1      | 0      | OK      |    5.7 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-single    | WiFi  1024 buffer                      | 1      | 0      | OK      |   5.64 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-single    | WiFi  4096 buffer                      | 1      | 0      | OK      |   2.61 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-single    | WiFi network setup                     | 1      | 0      | OK      |   8.48 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-single    | ----- TOTAL -----                      | 5      | 0      | OK      |  87.74 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-stress-net-fs | SPIF+LFS format                        | 1      | 0      | OK      |   0.14 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-stress-net-fs | SPIF+LFS+WiFi 1 thread, dl, file seq.  | 1      | 0      | OK      |   5.64 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-stress-net-fs | SPIF+LFS+WiFi 2 threads, dl, 1kb       | 1      | 0      | OK      |  11.56 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-stress-net-fs | SPIF+LFS+WiFi 3 threads, dl, 256b, 1kb | 1      | 0      | OK      |  19.72 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-stress-net-fs | WiFi network setup                     | 1      | 0      | OK      |   8.48 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-stress-net-fs | ----- TOTAL -----                      | 5      | 0      | OK      | 102.78 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-threaded  | WiFi 1 thread                          | 1      | 0      | OK      |   5.15 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-threaded  | WiFi 2 threads                         | 1      | 0      | OK      |    4.2 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-threaded  | WiFi network setup                     | 1      | 0      | OK      |   6.48 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-net-threaded  | ----- TOTAL -----                      | 3      | 0      | OK      |  73.28 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-threaded   | SPIF+LFS 2 files, buff 4b/256b         | 1      | 0      | OK      |  16.53 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-threaded   | SPIF+LFS 3 files, buff 256b/1kb/4kb    | 1      | 0      | OK      |  23.04 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-threaded   | SPIF+LFS format                        | 1      | 0      | OK      |   0.15 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-threaded   | ----- TOTAL -----                      | 3      | 0      | OK      |  79.68 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Connect to WiFi                        | 1      | 0      | OK      |   8.53 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Simple PDMC                 | 0      | 1      | FAIL    |  36.21 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Storage                     | 1      | 0      | OK      |   0.03 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Bootstrap & Reg.                | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Directory                       | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Re-register                     | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Post-reset Identity                    | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M GET                     | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M POST                    | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M PUT                     | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M SET                     | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-connect    | ----- TOTAL -----                      | 2      | 1      | FAIL    | 106.28 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | SPIF+LFS 1 file, buff     1            | 1      | 0      | OK      |  10.06 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | SPIF+LFS 1 file, buff     4            | 1      | 0      | OK      |   8.27 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | SPIF+LFS 1 file, buff    16            | 1      | 0      | OK      |   8.02 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | SPIF+LFS 1 file, buff    64            | 1      | 0      | OK      |   7.86 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | SPIF+LFS 1 file, buff   256            | 1      | 0      | OK      |   7.85 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | SPIF+LFS 1 file, buff  1024            | 1      | 0      | OK      |   7.77 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | SPIF+LFS 1 file, buff  4096            | 1      | 0      | OK      |    7.3 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | SPIF+LFS 1 file, buff 16384            | 1      | 0      | OK      |   7.19 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | SPIF+LFS format                        | 1      | 0      | OK      |   0.16 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-basic-fs-single     | ----- TOTAL -----                      | 9      | 0      | OK      | 107.23 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Connect to WiFi                        | 1      | 0      | OK      |   6.54 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Simple PDMC                 | 0      | 1      | FAIL    |  36.21 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Storage                     | 1      | 0      | OK      |   0.03 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Bootstrap & Reg.                | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Directory                       | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Download               | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Prepare                | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Update                 | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Re-register                     | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Erase                      | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Identity                   | 0      | 0      | SKIPPED |    0.0 |
| MTB_USI_WM_BN_BM_22-ARM | MTB_USI_WM_BN_BM_22 | simple-mbed-cloud-client-tests-dev_mgmt-update     | ----- TOTAL -----                      | 2      | 1      | FAIL    | 103.93 |
+-------------------------+---------------------+----------------------------------------------------+----------------------------------------+--------+--------+---------+--------+

[2018-12-05 21:41:34] INFO: EXEC: "mbed test --compile -t ARM -m NUCLEO_F767ZI -n simple-mbed-cloud-client-tests* -v" (code: 0)
None
[2018-12-05 21:41:34] ERROR: FAILED: "mbed test --run -t ARM -m NUCLEO_F767ZI --report-json TEST_OUTPUT\e0c32da4c8ab4763770560b7eb98e5bc5e876dbc\2018-12-05 20-52-28/NUCLEO_F767ZI_ARM_results.json -n simple-mbed-cloud-client-tests* -v" (code: 3)
None
[2018-12-05 21:41:34] INFO: TEST RESULTS

+-------------------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+---------+--------+
| target            | platform_name | test suite                                         | test case                                | passed | failed | result  |   time |
+-------------------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+---------+--------+
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet   128 buffer                    | 1      | 0      | OK      |   9.28 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet   256 buffer                    | 1      | 0      | OK      |   5.53 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet  1024 buffer                    | 1      | 0      | OK      |   1.87 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet  4096 buffer                    | 1      | 0      | OK      |   1.86 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-single    | Ethernet network setup                   | 1      | 0      | OK      |   3.01 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-single    | ----- TOTAL -----                        | 5      | 0      | OK      |  42.91 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | Ethernet network setup                   | 1      | 0      | OK      |   4.01 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT format                            | 1      | 0      | OK      |   0.08 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 1 thread, dl, file seq.  | 1      | 0      | OK      |   5.61 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 2 threads, dl, 1kb       | 1      | 0      | OK      |  23.31 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | SD+FAT+Ethernet 3 threads, dl, 256b, 1kb | 1      | 0      | OK      |  42.38 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-stress-net-fs | ----- TOTAL -----                        | 5      | 0      | OK      |   97.4 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet 1 thread                        | 1      | 0      | OK      |   1.88 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet 2 threads                       | 1      | 0      | OK      |   3.93 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-threaded  | Ethernet network setup                   | 1      | 0      | OK      |   3.01 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-net-threaded  | ----- TOTAL -----                        | 3      | 0      | OK      |  30.11 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-threaded   | SD+FAT 2 files, buff 4b/256b             | 1      | 0      | OK      |  37.17 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-threaded   | SD+FAT 3 files, buff 256b/1kb/4kb        | 1      | 0      | OK      |  60.01 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-threaded   | SD+FAT format                            | 1      | 0      | OK      |   0.08 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-threaded   | ----- TOTAL -----                        | 3      | 0      | OK      | 117.89 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Connect to Ethernet                      | 1      | 0      | OK      |   4.05 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Simple PDMC                   | 0      | 1      | FAIL    |  85.59 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Initialize Storage                       | 1      | 0      | OK      |   0.04 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Bootstrap & Reg.                  | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Directory                         | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Pelion Re-register                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Post-reset Identity                      | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M GET                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M POST                      | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M PUT                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | Resource LwM2M SET                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-connect    | ----- TOTAL -----                        | 2      | 1      | FAIL    |  114.1 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff     1                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff     4                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff    16                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff    64                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff   256                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff  1024                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff  4096                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT 1 file, buff 16384                | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | SD+FAT format                            | 0      | 1      | FAIL    |   0.03 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-basic-fs-single     | ----- TOTAL -----                        | 0      | 1      | FAIL    |   20.7 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Connect to Ethernet                      | 1      | 0      | OK      |   4.55 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Simple PDMC                   | 0      | 1      | FAIL    |  68.83 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Initialize Storage                       | 1      | 0      | OK      |   0.05 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Bootstrap & Reg.                  | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Directory                         | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Download                 | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Prepare                  | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Firmware Update                   | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Pelion Re-register                       | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Erase                        | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | Post-update Identity                     | 0      | 0      | SKIPPED |    0.0 |
| NUCLEO_F767ZI-ARM | NUCLEO_F767ZI | simple-mbed-cloud-client-tests-dev_mgmt-update     | ----- TOTAL -----                        | 2      | 1      | FAIL    |  97.72 |
+-------------------+---------------+----------------------------------------------------+------------------------------------------+--------+--------+---------+--------+
micgur01 commented 5 years ago

sure, I am rolling back test changes now, after your fix as client not formatting filesystem before init, it should not be a problem this was the case on released 2.0.1 code

micgur01 commented 5 years ago

Hi Could you please rerun the tests now? rollback the test changes Could you please help me to fix the SYNC_FAILED after this upgrade , can't run the tests anymore. pip install -U mbed-host-tests mbed-greentea – done

micgur01 commented 5 years ago

by the way, are you running the tests using corresponded pull request? https://github.com/ARMmbed/simple-mbed-cloud-client-template-restricted/pull/44

also test compilation and run include --app-config mbed_app_test.json. the reason why we need different json for test is: we have to use bin file for testing( so we can just copy the files) for production mode you need hex file, unless all data saved by factory configuration client would be erased. And sotp section for 429 should be alighted with FCCE

On the other hand , we should move sotp section of STM(429 ) in case of bin file to be above application or it will be erased.

MarceloSalazar commented 5 years ago

Merging to continue testing on production-workflow branch