Unpack a 5GTANGO package using REST

[mpeuster]

• [x] call unpacking using CLI
• [x] call unpacking using REST
• [x] unpackaging procedure (TODO more details)
  • [x] create wiki page to document TangoPackager and EtsiPackager
  • [x] extract package file to temp dir.
  • [x] collect all infos about package (define a clear order in which manifests are checked, document it)
    • [x] read TOSCA.meta, ETSI MF, NAPD.yaml
    • [x] validate NAPD against its schema
    • [x] unify metadata from different files (fill empty NAPD skeleton if no NAPD is there)
    • [x] assert that a minimum set of meta data is available or abort packaging process (generic function that should work on all package spec. levels)
  • [x] validate checksums
    • [x] compute and compare checksums
    • [x] error handling CLI mode
    • [x] error handling REST mode
    • [x] --ignore flag
  • [x] add example commands from comments to README.md
  • [x] call storage backend for each extracted artifact
  • [x] generate and return result (w. links if service)
  • [x] REST: send full callback payload (id, metadata, ...) -> return record as result of _do_unpack...
• [ ] ~store to local file backend (replaces catalogue for first version)~
• [x] failure management: produce logs in service mode, but do not stop service if something fails
• [x] IMPORTANT implement specific unittests for 5GTANGO packager (use example package)

Additional features

We might create independent issues for these.

• [x] CLI mode: nicer output and result overview (cli.py dispatch method)
• [x] helper to guess mime types (e.g. packager: _etsi_to_napd_package_content)

We skip label and reference support in v0.

[mpeuster]

Example command: tng-package -u misc/5gtango-ns-package-example.tgo -o /tmp -v

[mpeuster]

Status: Started to parse TOSCA.meta file

[mpeuster]

Status: TOSCA.meta, ETSI MF and NAPD are read. Now metadata needs to be combined.

[mpeuster]

Status: TOSCA.meta and ETSI MF are merged to empty NapdRecord. Next step: Deep-merge NAPD.yaml into NapdRecord (packager.py l.101) Unittests for this!

[mpeuster]

Next step: Complete _assert_usable_tango_package (packager.py l463) Done.

[mpeuster]

Next steps (packager.py l440):

• find file and compute checksum
• compare checksums

[mpeuster]

Next step: Refactor checksum method and its error handling

[mpeuster]

Next step: Error handling in REST mode

# terminal A
python misc/callback_mock.py

# terminal B
tng-package -s

# terminal C
## good package 
curl -X POST -v -H "Content-Type: multipart/form-data" \
    -F callback_url="http://127.0.0.1:8000/api/v1/packages/on-change" \
    -F package="@misc/5gtango-ns-package-example.tgo" \
    http://127.0.0.1:5099/api/v1/packages

## bad package
curl -X POST -v -H "Content-Type: multipart/form-data" \
    -F callback_url="http://127.0.0.1:8000/api/v1/packages/on-change" \
    -F package="@misc/5gtango-ns-package-example-malformed.tgo" \
    http://127.0.0.1:5099/api/v1/packages

[mpeuster]

Next:

• --ignore flag
• return package_id in callback

[mpeuster]

Done!