search

HydraRadio / hydra-pspec

Gibbs sampler-based power spectrum estimation code with foreground filtering and in-painting capabilities
4 stars 0 forks source link

Runs on H1C IDR2.2 data (issue summary) #73

Open philbull opened 3 hours ago

philbull commented 3 hours ago

This issue just summarises problems with running hydra-pspec on real data as they come up.

philbull commented 3 hours ago

Even though --clobber is set, it doesn't like the existing JSON file. The MPI job does not fail when this error is thrown. It just hangs.


Traceback (most recent call last):
  File "/cosma/home/dp270/dc-bull2/software/hydra-pspec/run-hydra-pspec.py", line 357, in <module>
    parser.save(args, out_dir / "args.json", format="json_indented", skip_none=False)
  File "/cosma/home/dp270/dc-bull2/.conda/envs/hera/lib/python3.9/site-packages/jsonargparse/_deprecated.py", line 159, in patched_save
    return self._unpatched_save(cfg, *args, multifile=multifile, **kwargs)
  File "/cosma/home/dp270/dc-bull2/.conda/envs/hera/lib/python3.9/site-packages/jsonargparse/_core.py", line 836, in save
    check_overwrite(path_fc)
  File "/cosma/home/dp270/dc-bull2/.conda/envs/hera/lib/python3.9/site-packages/jsonargparse/_core.py", line 817, in check_overwrite
    raise ValueError(f"Refusing to overwrite existing file: {path.absolute}")
ValueError: Refusing to overwrite existing file: /cosma8/data/dp270/dc-bull2/hera/IDR2_2/hydra_pspec/results-seed-7123689-Niter-1000/args.json```
philbull commented 3 hours ago

Running using command-line arguments doesn't work unless a config file is also specified. So may as well just use the config file.