Install issue for dev - Githubissues

I successfully installed and compiled the daliuge code (option dev) following the instructions in https://daliuge.readthedocs.io/en/latest/installing.html

But when I try and run it fails in the translator. Text below, but any ideas? dep works ...

rdodson@dep66340 daliuge-engine % ./run_engine.sh dev
./run_engine.sh: line 12: nvidia-docker: command not found Running Engine development version in background... docker run -td --shm-size=2g --ipc=shareable --rm --name daliuge-engine -v /var/run/docker.sock:/var/run/docker.sock -p 5555:5555 -p 6666:6666 -p 8000:8000 -p 8001:8001 -p 8002:8002 -p 9000:9000 --user 503:20 --group-add 20 -v /Users/rdodson/dlg/workspace/settings/passwd:/etc/passwd -v /Users/rdodson/dlg/workspace/settings/group:/etc/group -v /Users/rdodson/dlg:/Users/rdodson/dlg --env DLG_ROOT=/Users/rdodson/dlg icrar/daliuge-engine:master fac46404c22aa459a1682755d9c8a26875c7bf0497085d37ab74aa7b3aca3add {"pid": 45}% r

dodson@dep66340 daliuge-engine % cd ../daliuge-translator rdodson@dep66340 daliuge-translator % ./run_translator.sh dev Running Translator development version in foreground... Traceback (most recent call last): File "/dlg/bin/dlg", line 8, in sys.exit(run()) File "/dlg/lib/python3.8/site-packages/dlg/common/tool.py", line 166, in run commands[cmd]1 File "/dlg/lib/python3.8/site-packages/dlg/common/tool.py", line 106, in wrapped f(parser, *args, **kwargs) File "/dlg/lib/python3.8/site-packages/dlg/common/tool.py", line 99, in call module = importlib.import_module(modname) File "/usr/lib/python3.8/importlib/init.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 1014, in _gcd_import File "", line 991, in _find_and_load File "", line 975, in _find_and_load_unlocked File "", line 671, in _load_unlocked File "", line 848, in exec_module File "", line 219, in _call_with_frames_removed File "/dlg/lib/python3.8/site-packages/dlg/dropmake/web/translator_rest.py", line 968, in default=AlgoParams(), File "/dlg/lib/python3.8/site-packages/pydantic/main.py", line 159, in init pydantic_self.pydantic_validator.validate_python(data, self_instance=__pydantic_self__) pydantic_core._pydantic_core.ValidationError: 9 validation errors for AlgoParams min_goal Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing ptype Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing max_load_imb Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing max_cpu Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing time_greedy Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing deadline Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing topk Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing swarm_size Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing max_mem Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing

Hi Richard,

I've fixed this now on master, but you have to pull the code again and build it from scratch.

Cheers, Andreas

On Tue, Aug 8, 2023 at 11:10 AM dodsonicrar @.***> wrote:

I successfully installed and compiled the daliuge code (option dev) following the instructions in https://daliuge.readthedocs.io/en/latest/installing.html

But when I try and run it fails in the translator. Text below, but any ideas? dep works ...

@.** daliuge-engine % ./run_engine.sh dev ./run_engine.sh: line 12: nvidia-docker: command not found* Running Engine development version in background... docker run -td --shm-size=2g --ipc=shareable --rm --name daliuge-engine -v /var/run/docker.sock:/var/run/docker.sock -p 5555:5555 -p 6666:6666 -p 8000:8000 -p 8001:8001 -p 8002:8002 -p 9000:9000 --user 503:20 --group-add 20 -v /Users/rdodson/dlg/workspace/settings/passwd:/etc/passwd -v /Users/rdodson/dlg/workspace/settings/group:/etc/group -v /Users/rdodson/dlg:/Users/rdodson/dlg --env DLG_ROOT=/Users/rdodson/dlg icrar/daliuge-engine:master fac46404c22aa459a1682755d9c8a26875c7bf0497085d37ab74aa7b3aca3add {"pid": 45}% r

@. daliuge-engine % cd ../daliuge-translator @. daliuge-translator % ./run_translator.sh dev Running Translator development version in foreground... Traceback (most recent call last): File "/dlg/bin/dlg", line 8, in sys.exit(run()) File "/dlg/lib/python3.8/site-packages/dlg/common/tool.py", line 166, in run commands[cmd]1 File "/dlg/lib/python3.8/site-packages/dlg/common/tool.py", line 106, in wrapped f(parser, *args, *kwargs) File "/dlg/lib/python3.8/site-packages/dlg/common/tool.py", line 99, in call module = importlib.import_module(modname) File "/usr/lib/python3.8/importlib/init.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 1014, in _gcd_import File "", line 991, in _find_and_load File "", line 975, in _find_and_load_unlocked File "", line 671, in _load_unlocked File "", line 848, in exec_module File "", line 219, in _call_with_frames_removed File "/dlg/lib/python3.8/site-packages/dlg/dropmake/web/translator_rest.py", line 968, in default=AlgoParams(), File "/dlg/lib/python3.8/site-packages/pydantic/main.py", line 159, in init pydantic_self.pydantic_validator.validate_python(data, self_instance= pydantic_self*) pydantic_core._pydantic_core.ValidationError: 9 validation errors for AlgoParams min_goal Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing ptype Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing max_load_imb Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing max_cpu Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing time_greedy Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing deadline Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing topk Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing swarm_size Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing max_mem Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.1/v/missing

— Reply to this email directly, view it on GitHub https://github.com/ICRAR/daliuge/issues/236, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAJVMSG2ARN3QB3PW6FQZILXUGUZHANCNFSM6AAAAAA3H2EGBQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

ICRAR / daliuge

Install issue for dev #236