umr-lops / xsarsea

scientific functions to compute radar or geophysical parameters from satellite images over ocean
https://cerweb.ifremer.fr/datarmor/doc_sphinx/xsarsea/
MIT License
10 stars 6 forks source link

import cv2 ImportError: dlopen: cannot load any more object with static TLS #74

Open Skealz opened 2 weeks ago

Skealz commented 2 weeks ago
2024-09-09 15:27 datarmor1    sarwing    qsubarray_wait   : Error from /home1/scratch/sarwing/qsubarray/sarwing/20240909/1522-qTa/cache/c69e19dab5aef90145000
964502ac0f9/stdout:
version file : /home/datawork-cersat-public/cache/public/ftp/project/sarwing/processings/xsar_2024v7v30_1v2_0v2v3vpost15_1v1v1_1v0v6_1v0v6_1v1v11_1v0v3_1v0v1
_1v2v1/all_plugins_cmod5n_ecmwf/rcm/rcm-1/sc50mb/2022/268/RCM1_OK2378142_PK2381315_1_SC50MB_20220925_233123_HH_HV_GRD/.sarL2Processor/OWI.version
logname: no login name
Mon Sep  9 15:23:10 GMT 2024
@r2i1n20:/home1/datahome/sarwing%  SAR_L1-to-L2_wind_processor --input_file /home/datawork-cersat-public/provider/csa/satellite/l1/rcm/rcm-1/sc50mb/2022/268/
RCM1_OK2378142_PK2381315_1_SC50MB_20220925_233123_HH_HV_GRD --outputdir /home/datawork-cersat-public/cache/public/ftp/project/sarwing/processings/xsar_2024v7
v30_1v2_0v2v3vpost15_1v1v1_1v0v6_1v0v6_1v1v11_1v0v3_1v0v1_1v2v1/all_plugins_cmod5n_ecmwf/rcm/rcm-1/sc50mb/2022/268/RCM1_OK2378142_PK2381315_1_SC50MB_20220925
_233123_HH_HV_GRD --config_file /home/datawork-cersat-public/cache/project/sarwing/configs/grdwind_cmod5n_ecmwf.yaml

====================================

Traceback (most recent call last):
  File "/home/datawork-cersat-public/cache/project/sarwing/commits/xsar_2024v7v30_1v2_0v2v3vpost15_1v1v1_1v0v6_1v0v6_1v1v11_1v0v3_1v0v1_1v2v1/grdwindinversio
n/bin/SAR_L1-to-L2_wind_processor", line 7, in <module>
    from grdwindinversion.main import processor_starting_point
  File "/home/datawork-cersat-public/cache/project/sarwing/commits/xsar_2024v7v30_1v2_0v2v3vpost15_1v1v1_1v0v6_1v0v6_1v1v11_1v0v3_1v0v1_1v2v1/grdwindinversio
n/lib/python3.10/site-packages/grdwindinversion/__init__.py", line 7, in <module>
    from grdwindinversion import *
  File "/home/datawork-cersat-public/cache/project/sarwing/commits/xsar_2024v7v30_1v2_0v2v3vpost15_1v1v1_1v0v6_1v0v6_1v1v11_1v0v3_1v0v1_1v2v1/grdwindinversio
n/lib/python3.10/site-packages/grdwindinversion/inversion.py", line 18, in <module>
    from grdwindinversion.streaks import get_streaks
  File "/home/datawork-cersat-public/cache/project/sarwing/commits/xsar_2024v7v30_1v2_0v2v3vpost15_1v1v1_1v0v6_1v0v6_1v1v11_1v0v3_1v0v1_1v2v1/grdwindinversio
n/lib/python3.10/site-packages/grdwindinversion/streaks.py", line 2, in <module>
    import xsarsea.gradients
  File "/home/datawork-cersat-public/cache/project/sarwing/commits/xsar_2024v7v30_1v2_0v2v3vpost15_1v1v1_1v0v6_1v0v6_1v1v11_1v0v3_1v0v1_1v2v1/grdwindinversio
n/lib/python3.10/site-packages/xsarsea/gradients.py", line 19, in <module>
    import cv2
ImportError: dlopen: cannot load any more object with static TLS
Skealz commented 1 week ago

Happens when executing on datarmor cluster

Skealz commented 1 week ago

Can reproduce using only :

from scipy import signal, ndimage
import xarray as xr
import cv2

Using only 1 import before cv2 did not trigger the error. Re-try to import cv2 after the error seems to work.