search

destination-earth-digital-twins / DE330_Training_2024

1 stars 2 forks source link

Starting the deode ecflow suite #5

Open iljamal opened 3 months ago

iljamal commented 3 months ago

I have issue with python not finding ecflow module during deode suitr start ...

I have these modules loaded: module load python3/3.10.10-01 module load ecflow

and deode_ui GUI loads well but

deode start suite 2024-06-17 10:00:46 | INFO | Start deode v0.5.0 --> "deode start suite" 2024-06-17 10:00:47 | INFO | Set basetime to 2023-09-16T00:00:00Z 2024-06-17 10:00:47 | INFO | Set validtime to 2023-09-16T00:00:00Z 2024-06-17 10:00:47 | INFO | Starting suite... 2024-06-17 10:00:47 | INFO | Config file: /etc/ecmwf/nfs/dh1_home_b/eeim/Deode-Workflow/deode/data/config_files/config.toml 2024-06-17 10:00:47 | INFO | Ecflow settings: 2024-06-17 10:00:47 | INFO | ecf_host: ecflow-gen-eeim-001 2024-06-17 10:00:47 | INFO | ecf_jobout: /home/eeim/deode_ecflow/jobout 2024-06-17 10:00:47 | INFO | ecf_files: /home/eeim/deode_ecflow/ecf_files 2024-06-17 10:00:47 | INFO | ecf_files_remotely: /home/eeim/deode_ecflow/ecf_files 2024-06-17 10:00:47 | INFO | ecf_home: /home/eeim/deode_ecflow/jobout 2024-06-17 10:00:47 | INFO | ecf_user: 2024-06-17 10:00:47 | INFO | ecf_remoteuser: 2024-06-17 10:00:47 | INFO | suite definition: DeodeSuiteDefinition Traceback (most recent call last): File "/home/eeim/mambaforge/envs/cmc-beta/bin/deode", line 6, in sys.exit(main()) ^^^^^^ File "/etc/ecmwf/nfs/dh1_home_b/eeim/Deode-Workflow/deode/logs.py", line 106, in wrapper function_rtn = function(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/etc/ecmwf/nfs/dh1_home_b/eeim/Deode-Workflow/deode/main.py", line 27, in main args.run_command(args=args, config=config) File "/etc/ecmwf/nfs/dh1_home_b/eeim/Deode-Workflow/deode/commands_functions.py", line 195, in start_suite server = EcflowServer(config, start_command=args.start_command) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/etc/ecmwf/nfs/dh1_home_b/eeim/Deode-Workflow/deode/scheduler.py", line 97, in init raise ModuleNotFoundError("Ecflow not found") ModuleNotFoundError: Ecflow not found

*** testing different pythons [eeim@ac6-100 ~]$ python3.10 Python 3.10.10 (main, Feb 9 2023, 14:42:48) [GCC 8.5.0 20210514 (Red Hat 8.5.0-10)] on linux Type "help", "copyright", "credits" or "license" for more information.

import ecflow

[eeim@ac6-100 ~]$ python Python 3.11.7 | packaged by conda-forge | (main, Dec 23 2023, 14:43:09) [GCC 12.3.0] on linux Type "help", "copyright", "credits" or "license" for more information. import ecflow Traceback (most recent call last): File "", line 1, in ModuleNotFoundError: No module named 'ecflow'

[eeim@ac6-100 ~]$ python3 Python 3.10.10 (main, Feb 9 2023, 14:42:48) [GCC 8.5.0 20210514 (Red Hat 8.5.0-10)] on linux Type "help", "copyright", "credits" or "license" for more information. import ecflow

[eeim@ac6-100 ~]$

iljamal commented 3 months ago

Solved ... somehow Had to shake off previous mambaforge py environment and re-install from clear? py environment.

FlorianW-ZAMG commented 3 months ago

Okay, so the different python installations somehow interfered with each other? Might be something we can try to avoid in the workflow.