ldes client sink fails to start up

zargha commented 2 years ago

The Problem

While testing out the e2e gipod test https://github.com/Informatievlaanderen/VSDS-LDES-E2E-testing/tree/main/e2e-test/use-cases/gipod/1.replicate-ldes, the vsds/ldes-client-sink fails to run.

Environment

Components under test

vsds/ldes-server-simulator
vsds/ldes-client-sink

vsds/ldes-client-workflow

$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.4 LTS
Release:        20

$ docker --version
Docker version 20.10.17, build 100c701
$ docker compose version
Docker Compose version v2.6.0

The GitHub commit: https://github.com/Informatievlaanderen/VSDS-LDES-E2E-testing/commit/9b217b92921b454c9caee87d2be21eb578dc28f9
Docker image tag: ldes-client-sink:20220819T1230

Error logs

ldes-client-sink       | Arguments:  {
ldes-client-sink       |   _: [],
ldes-client-sink       |   host: '0.0.0.0',
ldes-client-sink       |   port: 80,
ldes-client-sink       |   memory: '',
ldes-client-sink       |   silent: '',
ldes-client-sink       |   'member-type': '',
ldes-client-sink       |   'connection-uri': '',
ldes-client-sink       |   'database-name': '',
ldes-client-sink       |   'collection-name': ''
ldes-client-sink       | }
ldes-client-sink       | missing value for mandatory argument "--member-type".
ldes-client-sink exited with code 1

Steps to reproduce

Start you system as described here

During docker compose up the problem occurs.

Yalz commented 2 years ago

Hi @zargha , Could you show me your env.user file that you use for this test? Since, as the error is mentioning all arguments are empty

zargha commented 2 years ago

Hi @zargha , Could you show me your env.user file that you use for this test? Since, as the error is mentioning all arguments are empty

# Simulator compose env vars
LDES_SERVER_SIMULATOR_TAG=20220718T1542
LDES_SERVER_SIMULATOR_PORT=9011
LDES_SERVER_SIMULATOR_SEED_FOLDER=../../../../ldes-server-simulator/data/gipod

# Workflow compose env vars
PAT_READ_PACKAGES=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
LDES_CLIENT_NAR_TAG=20220704.153332-11
NIFI_UI_PORT=8445
SINGLE_USER_CREDENTIALS_USERNAME=admin
SINGLE_USER_CREDENTIALS_PASSWORD=ctsBtRBKHRAx69EqUghvvgEvjnaLjFEB
# Sink compose env vars
LDES_CLIENT_SINK_TAG=20220819T1230
LDES_CLIENT_SINK_PORT=9003

Yalz commented 2 years ago

Although I think there might be another problem, I do not see the following properties?

LDES_CLIENT_SINK_MEMBER_TYPE="https://data.vlaanderen.be/ns/mobiliteit#Mobiliteitshinder" LDES_CLIENT_SINK_DATABASE_NAME="GIPOD" LDES_CLIENT_SINK_COLLECTION_NAME="mobility-hindrances"

rorlic commented 2 years ago

@zargha, we now support a sink with mongodb as storage, so the env.replicate has been updated. You need to copy it again to env.user and append your settings.

zargha commented 2 years ago

@zargha, we now support a sink with mongodb as storage, so the env.replicate has been updated. You need to copy it again to env.user and append your settings.

Thanks @rorlic indeed thats the case! i am validating sprint 7 so i was on different git commit: 9b217b92921b454c9caee87d2be21eb578dc28f9 if i switch to main, then i see the updated env.replicate

zargha commented 2 years ago

Issue tested with LDES_CLIENT_SINK_TAG=20220818t1548 and git branch: main

Informatievlaanderen / VSDS-LDES-E2E-testing