caracal-pipeline / caracal

Containerized Automated Radio Astronomy Calibration (CARACal) pipeline
GNU General Public License v2.0
28 stars 6 forks source link

Error in line worker #1452

Closed viralp closed 1 year ago

viralp commented 1 year ago

Hi,

I am getting following error in wsclean run in the line worker

# + + + + + + + + + + + + + + + + + + +
# + An exception occured:
# + >>> RegularFileIO: error in open or create of file /stimela_mount/msdir/NGC1512_raw_data2-NGC1512-corr_mst.ms/table.dat: Too many open files
# + + + + + + + + + + + + + + + + + + +
# Traceback (most recent call last):
#   File "/stimela_mount/code/run.py", line 69, in <module>
#     subprocess.check_call(shlex.split(_runc))
#   File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
#     raise CalledProcessError(retcode, cmd)

It's working with only few 100 channels but failing when using all channels. log-caracal.txt

paoloserra commented 1 year ago

Can you check whether this is the same problem as in #998? See ulimit.

See also #1414

paoloserra commented 1 year ago

Did this work?

paoloserra commented 1 year ago

@viralp can we close this?

viralp commented 1 year ago

Yes

On Tue, 13 Dec 2022 at 15:07, paoloserra @.***> wrote:

@viralp https://github.com/viralp can we close this?

— Reply to this email directly, view it on GitHub https://github.com/caracal-pipeline/caracal/issues/1452#issuecomment-1348059006, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABBBM4Z3YVF4MPCPL7UW2HLWNA7VHANCNFSM6AAAAAARRIG2W4 . You are receiving this because you were mentioned.Message ID: @.***>