IS-ENES-Data / QA-DKRZ

Quality and CF checker of meta-data in climate related data sets (NetCDF files)
4 stars 4 forks source link

KeyError: 'period' #23

Open JavierDiezSierra opened 4 years ago

JavierDiezSierra commented 4 years ago

I am having problems when executing the qa-dkrz:

(qa-dkrz) [user @] $ qa-dkrz -f test.conf
~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/bin/syncFiles.x: error while loading shared libraries: libssl.so.1.0.0: cannot open shared object file: No such file or directory

(qa-dkrz) [user @] $ conda install openssl = 1.0

(qa-dkrz) [user @] $ qa-dkrz -f test.conf
Traceback (most recent call last):
  File "~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/python/qa-dkrz/qa-dkrz.py", line 669, in <module>
    run ()
  File "~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/python/qa-dkrz/qa-dkrz.py", line 561, in run
    if not launch_list [0] .start (queue,):
  File "~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/python/qa-dkrz/qa_exec.py", line 723, in start
    if not self.run (t_vars):
  File "~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/python/qa-dkrz/qa_exec.py", line 583, in run
    period = log_entry ['period'],
KeyError: 'period'

The installation was made on a CentOS 6.X machine with the following commands (miniconda2 was previously installed):

conda create -n qa-dkrz -c conda-forge -c h-dh qa-dkrz = 0.6.7 = 55
conda activate qa-dkrz
qa-dkrz install --up --force CORDEX

The software works perfectly in Ubuntu 18.04

(@cofinoa)

cofinoa commented 4 years ago

@h-dh the error on non-existing key period it's because the binary execution doing the actual test it's raising a Segmentation Fault.

Please if you need further information, please let us to know.

h-dh commented 4 years ago

a new version of the qa-dkrz tool is in preparation. However, it will not be available before next week.

Could you, please, have a look at your ~/.qa-dkrz/config.txt file, in particular for the QA_TABLE entry? Is it well defined?

JavierDiezSierra commented 4 years ago

I think is well define because we have compared the QA_TABLE entry for both machines (Ubuntu 18.04 and CentOS 6.X) and it does not seem to present anything wrong:

QA_TABLES=~/user/.qa-dkrz/QA_TABLES

Find attached the config.txt file.

Many thanks for your help.

JavierDiezSierra commented 4 years ago

We found that the kernel of the CentOS 6.X machine must be updated (from 3.10 to a 4.4 version) to solve the problem.

We look forward to the new version of the qa-dkrz tool!

cofinoa commented 4 years ago

@h-dh we were using a CentOS 7.7 distribution with linux kernel 3.10, and upgrading it to linux kernel 4.4, the segmentation fault, disappear. To me, I think it's an issue with the GLIB version used by the conda build process, that makes the executable to raise the segmentation fault.

Please could let us know when it's planned the next release?

I was looking for the release, 0.6.7, but it's not in this repo. Where can we access it?

thank you

h-dh commented 4 years ago

Hi *,

On 3/3/20 3:39 PM, Antonio S. Cofiño wrote:

@h-dh https://github.com/h-dh we were using a CentOS 7.7 distribution with linux kernel 3.10, and upgrading it to linux kernel 4.4, the segmentation fault, disappear. To me, I think it's an issue with the GLIB version used by the conda build process, that makes the executable to raise the segmentation fault.

This is a knowm problem with conda. Apparently from an internet search, conda does not encapsulate libc (and a few more), because this is too deeply dependent on the OS the package where it was built. So, the qa-dkrz package is usually built on an old machine hoping that a newer libc of the machine where it is installed can cope with that.

cheers, hdh

Please could let us know when it's planned the next release?

I was looking for the release, 0.6.7, but it's not in this repo. Where can we access it?

thank you

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/IS-ENES-Data/QA-DKRZ/issues/23?email_source=notifications&email_token=ACJZOW6K52PLF6LWZCAU7XDRFUJD3A5CNFSM4KYKQNLKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOENTXV5I#issuecomment-593984245, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACJZOWZXXWHNIRBO2R3F3NDRFUJD3ANCNFSM4KYKQNLA.

-- Dr. Heinz-Dieter Hollweg Abteilung Datenmanagement Deutsches Klimarechenzentrum GmbH (DKRZ) Bundesstraße 45a • D-20146 Hamburg • Germany

Phone: +49 40 460094-212 FAX: +49 40 460094-270 Email: hollweg@dkrz.de URL: www.dkrz.de

Geschäftsführer: Prof. Dr. Thomas Ludwig Sitz der Gesellschaft: Hamburg Amtsgericht Hamburg HRB 39784

ozanmert commented 2 years ago

Hello, I see that it is already a long time since this discussion, but I would like to ask anyway: Is there any improvement on this issue? I have recently installed qa-dkrz, but am stuck at this KeyError: 'period'. Many thanks in advance.