spacetelescope / jwst

Python library for science observations from the James Webb Space Telescope
https://jwst-pipeline.readthedocs.io/en/latest/
Other
559 stars 165 forks source link

Missing '/home/mwolfe/anaconda3/envs/condadev/lib/python3.6/site-packages/jwst-0.10.1a0.dev165+g5cca2f50-py3.6-linux-x86_64.egg/jwst/datamodels/schemas/dark.schema.yaml'. yaml file missing #2428

Closed stscijgbot closed 6 years ago

stscijgbot commented 6 years ago

Issue JP-362 was created by Michael Wolfe:

Traceback (most recent call last): File "breaking_nints_nis_bias.py", line 119, in split_nint_bias(input_files) File "breaking_nints_nis_bias.py", line 115, in split_nint_bias prepare_bias(sngl_nint) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/convert_niriss_bias.py", line 113, in prepare_bias cal_bias_strt(bias_files1) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/cal_pipe_bias_strt.py", line 58, in cal_bias_strt create_bias_y_int(bias_files2, bias_files3) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/create_bias_frm_y_int.py", line 344, in create_bias_y_int rc_corr(input_files, num_files_sn, num_files) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/rc_corr.py", line 348, in rc_corr split_nint_dark(input_files) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/breaking_nints_nis_darks.py", line 87, in split_nint_dark prepare_darks(sngl_nint) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/convert_niriss_dark.py", line 113, in prepare_darks cal_darks_strt(ind_dark_files1) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/cal_pipe_drk_strt.py", line 51, in cal_darks_strt create_darks(ind_dark_files2) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/ref_dark.py", line 319, in create_darks cal_darks_fnh(dark_file1) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/cal_pipe_drk_fnh_mn_drk.py", line 53, in cal_darks_fnh fnl_steps_drk(gain_file, dark_file, dark_file1) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/fnl_steps_ref_dark.py", line 713, in fnl_steps_drk change_datamodels(bias_file, dark_file) File "/ifs/jwst/wit/niriss/mwolfe/darks_biases/drk_bs_pipeline_test/full_frame/NISRAPID/bias_frm_y_int_pipe_lin_fit_odd_even_rows_true_dev/change_datamodels.py", line 149, in change_datamodels new_model = datamodels.DarkModel(data=sci_meand.copy()) File "/home/mwolfe/anaconda3/envs/condadev/lib/python3.6/site-packages/jwst-0.10.1a0.dev165+g5cca2f50-py3.6-linux-x86_64.egg/jwst/datamodels/dark.py", line 32, in init File "/home/mwolfe/anaconda3/envs/condadev/lib/python3.6/site-packages/jwst-0.10.1a0.dev165+g5cca2f50-py3.6-linux-x86_64.egg/jwst/datamodels/reference.py", line 20, in init File "/home/mwolfe/anaconda3/envs/condadev/lib/python3.6/site-packages/jwst-0.10.1a0.dev165+g5cca2f50-py3.6-linux-x86_64.egg/jwst/datamodels/model_base.py", line 103, in init File "/home/mwolfe/anaconda3/envs/condadev/lib/python3.6/site-packages/asdf/schema.py", line 360, in load_schema schema, url = loader(url) File "/home/mwolfe/anaconda3/envs/condadev/lib/python3.6/site-packages/asdf/schema.py", line 273, in load_schema return _load_schema(url) File "/home/mwolfe/anaconda3/envs/condadev/lib/python3.6/site-packages/asdf/schema.py", line 261, in _load_schema with generic_io.get_file(url) as fd: File "/home/mwolfe/anaconda3/envs/condadev/lib/python3.6/site-packages/asdf/generic_io.py", line 1186, in get_file fd = open(realpath, realmode) FileNotFoundError: [Errno 2] No such file or directory: '/home/mwolfe/anaconda3/envs/condadev/lib/python3.6/site-packages/jwst-0.10.1a0.dev165+g5cca2f50-py3.6-linux-x86_64.egg/jwst/datamodels/schemas/dark.schema.yaml' Bus error

 

I am in the dev version of the pipeline.

stscijgbot commented 6 years ago

Comment by Philip Hodge: I see that you have directory jwst-0.10.1a0.dev169+g7e5176c3-py3.6-linux-x86_64.egg/ under site-packages, but the error message indicates that the expected directory was jwst-0.10.1a0.dev165+g5cca2f50-py3.6-linux-x86_64.egg/ (i.e. dev169 vs dev165).

Do you use 'python setup.py develop'?  If so, perhaps you didn't do that after 'conda update'?

stscijgbot commented 6 years ago

Comment by Michael Wolfe: Do you use 'python setup.py develop'? If so, perhaps you didn't do that after 'conda update'?

I have not heard of python setup.py develop. I got the same error message last week but I updated my dev environment at that time.

stscijgbot commented 6 years ago

Comment by Steven Crawford: Have you tried updating the environment again? Or trying to create a new environment? It would appear that your current environment is missing that file despite it being in the repository.

stscijgbot commented 6 years ago

Comment by Steven Crawford: [~mwolfe] Any improvement with this or is this still a problem?

stscijgbot commented 6 years ago

Comment by Michael Wolfe: I deleted my condadev environment and re-installed and the analogous directory appears to be where it is supposed to be. I am re-running my pipeline. Will know if succesful or not in a few days.

stscicrawford commented 6 years ago

Closing issue but please re-open or create a new issue if this is still a problem

stscijgbot commented 5 years ago

Comment by Michael Wolfe [X]: Do you use 'python setup.py develop'? If so, perhaps you didn't do that after 'conda update'?

I have not heard of python setup.py develop. I got the same error message last week but I updated my dev environment at that time.

stscijgbot commented 5 years ago

Comment by Michael Wolfe [X]: I deleted my condadev environment and re-installed and the analogous directory appears to be where it is supposed to be. I am re-running my pipeline. Will know if succesful or not in a few days.