search

fermiPy / fermipy

Fermi-LAT Python Analysis Framework
http://fermipy.readthedocs.org/
BSD 3-Clause "New" or "Revised" License
51 stars 53 forks source link

Fermipy is not compatible with recent versions of its dependencies #547

Open adonath opened 1 year ago

adonath commented 1 year ago

When just installingfermipy with either conda or even pip one ends up with a non-working installation, because fermipy is not compatible with more recent version of its dependencies, such as numpy>1.22 or gammapy>1.0. It seems there is no sufficient resources to keep fermipy up to date. But in this case it would be good to let the users know which are the latest compatible versions, by either putting upper constraints in setup.py (non ideal but probably hard to avoid for an un-maintained package) or at least provide some conda environment.yml or requirements.txt file with a working environment specification (the one in the base repo does not work...). Otherwise the installation is a version guessing game, which is very frustrating for users.

So my concrete question here is which are the latest compatible versions of the following dependencies:

  "numpy>=1.16",
  "pyyaml",
  "scipy",
  "astropy",
  "matplotlib>=3.3",
  "gammapy>=0.18",
  "healpy",
  "astropy-healpix"

Thanks!

NithyaSathyan commented 9 months ago

@adonath Could you solve the above said issue. I have the same problem. Running the analysis script for fermipy, i get the following log file :

fermipy version 1.2.0 ScienceTools version 2.2.0 2023-12-30 22:50:12 INFO GTAnalysis.setup(): Running setup. 2023-12-30 22:50:12 INFO GTBinnedAnalysis.setup(): Running setup for component 00 2023-12-30 22:50:12 INFO GTBinnedAnalysis.run_gtapp(): Running gtselect. 2023-12-30 22:50:12 INFO GTBinnedAnalysis.run_gtapp(): time -p gtselect infile=/home/dell/Documents/1H1914-194/evfile_00.txt outfile=/home/dell/Documents/1H1914-194/ft1_00.fits ra=289.4383850097656 dec=-19.36280059814453 rad=7.5710678118654755 tmin=239557417.0 tmax=686188805.0 emin=1000.0 emax=300000.0 zmin=0.0 zmax=90.0 evclass=128 evtype=3 convtype=-1 phasemin=0.0 phasemax=1.0 evtable="EVENTS" chatter=3 clobber=yes debug=no gui=no mode="ql" 2023-12-30 22:50:13 INFO GTBinnedAnalysis.run_gtapp(): This is gtselect version HEAD 2023-12-30 22:50:14 INFO GTBinnedAnalysis.run_gtapp(): Applying filter string: ((EVENT_CLASS&o200) != o0) && angsep(RA,DEC,289.438385,-19.3628006) < 7.571067812 && ((EVENT_TYPE&o3) != o0) && 1000 < ENERGY && ENERGY <= 300000 && 239557417 < TIME && TIME <= 686188805 && 0 < ZENITH_ANGLE && ZENITH_ANGLE <= 90 && gtifilter() 2023-12-30 22:50:20 INFO GTBinnedAnalysis.run_gtapp(): Done. 2023-12-30 22:50:20 INFO GTBinnedAnalysis.run_gtapp(): Finished gtselect. Execution time: 7.89 s 2023-12-30 22:50:20 INFO GTBinnedAnalysis.run_gtapp(): Running gtltcube. 2023-12-30 22:50:20 INFO GTBinnedAnalysis.run_gtapp(): time -p gtltcube evfile="/home/dell/Documents/1H1914-194/ft1_00.fits" evtable="EVENTS" scfile=L2312300759163550A79855_SC00.fits sctable="SC_DATA" outfile=/home/dell/Documents/1H1914-194/ltcube_00.fits dcostheta=0.025 binsz=1.0 phibins=0 tmin=0.0 tmax=0.0 file_version="1" zmin=0.0 zmax=90.0 chatter=2 clobber=yes debug=no gui=no mode="ql" 2023-12-30 22:50:21 INFO GTBinnedAnalysis.run_gtapp(): Working on file L2312300759163550A79855_SC00.fits 2023-12-31 04:35:25 INFO GTBinnedAnalysis.run_gtapp(): .....................! 2023-12-31 04:35:32 INFO GTBinnedAnalysis.run_gtapp(): Finished gtltcube. Execution time: 20712.24 s 2023-12-31 04:35:43 INFO GTBinnedAnalysis.run_gtapp(): Running gtbin. 2023-12-31 04:35:43 INFO GTBinnedAnalysis.run_gtapp(): time -p gtbin evfile=/home/dell/Documents/1H1914-194/ft1_00.fits scfile=L2312300759163550A79855_SC00.fits outfile=/home/dell/Documents/1H1914-194/ccube_00.fits algorithm="ccube" ebinalg="LOG" emin=1000.0 emax=300000.0 enumbins=20 ebinfile=NONE tbinalg="LIN" tbinfile=NONE nxpix=100 nypix=100 binsz=0.1 coordsys="CEL" xref=289.4383850097656 yref=-19.36280059814453 axisrot=0.0 rafield="RA" decfield="DEC" proj="AIT" hpx_ordering_scheme="RING" hpx_order=3 hpx_ebin=yes hpx_region="" evtable="EVENTS" sctable="SC_DATA" efield="ENERGY" tfield="TIME" chatter=3 clobber=yes debug=no gui=no mode="ql" 2023-12-31 04:35:44 INFO GTBinnedAnalysis.run_gtapp(): This is gtbin version HEAD 2023-12-31 04:36:12 INFO GTBinnedAnalysis.run_gtapp(): Finished gtbin. Execution time: 29.55 s 2023-12-31 04:36:12 INFO GTBinnedAnalysis.run_gtapp(): Running gtexpcube2. 2023-12-31 04:36:12 INFO GTBinnedAnalysis.run_gtapp(): time -p gtexpcube2 infile=/home/dell/Documents/1H1914-194/ltcube_00.fits cmap=none outfile=/home/dell/Documents/1H1914-194/bexpmap_00.fits irfs="P8R3_SOURCE_V3" evtype=3 edisp_bins=-1 nxpix=360 nypix=180 binsz=1.0 coordsys="CEL" xref=0.0 yref=0.0 axisrot=0.0 proj="CAR" ebinalg="LOG" emin=1000.0 emax=300000.0 enumbins=20 ebinfile="NONE" hpx_ordering_scheme="RING" hpx_order=6 bincalc="EDGE" ignorephi=no thmax=180.0 thmin=0.0 table="EXPOSURE" chatter=3 clobber=yes debug=no mode="ql" 2023-12-31 04:36:14 INFO GTBinnedAnalysis.run_gtapp(): This is gtexpcube2 version HEAD 2023-12-31 04:36:15 INFO GTBinnedAnalysis.run_gtapp(): Using evtype=3 (i.e., FRONT/BACK irfs) 2023-12-31 04:36:15 INFO GTBinnedAnalysis.run_gtapp(): ResponseFunctions::load: IRF used: P8R3_SOURCE_V3 2023-12-31 04:36:15 INFO GTBinnedAnalysis.run_gtapp(): event_types: 0 1 2023-12-31 04:36:22 INFO GTBinnedAnalysis.run_gtapp(): Computing binned exposure map....................! 2023-12-31 04:36:23 INFO GTBinnedAnalysis.run_gtapp(): Finished gtexpcube2. Execution time: 10.33 s 2023-12-31 04:36:23 INFO GTBinnedAnalysis.run_gtapp(): Running gtexpcube2. 2023-12-31 04:36:23 INFO GTBinnedAnalysis.run_gtapp(): time -p gtexpcube2 infile=/home/dell/Documents/1H1914-194/ltcube_00.fits cmap=none outfile=/home/dell/Documents/1H1914-194/bexpmap_roi_00.fits irfs="P8R3_SOURCE_V3" evtype=3 edisp_bins=0 nxpix=100 nypix=100 binsz=0.1 coordsys="CEL" xref=289.4383850097656 yref=-19.36280059814453 axisrot=0.0 proj="CAR" ebinalg="LOG" emin=1000.0 emax=300000.0 enumbins=20 ebinfile="NONE" hpx_ordering_scheme="RING" hpx_order=6 bincalc="EDGE" ignorephi=no thmax=180.0 thmin=0.0 table="EXPOSURE" chatter=3 clobber=yes debug=no mode="ql" 2023-12-31 04:36:23 INFO GTBinnedAnalysis.run_gtapp(): This is gtexpcube2 version HEAD 2023-12-31 04:36:23 INFO GTBinnedAnalysis.run_gtapp(): Using evtype=3 (i.e., FRONT/BACK irfs) 2023-12-31 04:36:23 INFO GTBinnedAnalysis.run_gtapp(): ResponseFunctions::load: IRF used: P8R3_SOURCE_V3 2023-12-31 04:36:23 INFO GTBinnedAnalysis.run_gtapp(): event_types: 0 1 2023-12-31 04:36:25 INFO GTBinnedAnalysis.run_gtapp(): Computing binned exposure map....................! 2023-12-31 04:36:25 INFO GTBinnedAnalysis.run_gtapp(): Finished gtexpcube2. Execution time: 2.10 s WARNING: FITSFixedWarning: RADECSYS= 'FK5 ' the RADECSYS keyword is deprecated, use RADESYSa. [astropy.wcs.wcs] WARNING: FITSFixedWarning: 'datfix' made the change 'Set DATEREF to '2001-01-01T00:01:04.184' from MJDREF. Set MJD-OBS to 54682.655283 from DATE-OBS. Set MJD-END to 59852.000000 from DATE-END'. [astropy.wcs.wcs] Traceback (most recent call last): File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/fermipy/gtanalysis.py", line 5196, in setup self._bexp = Map.read(self.files['bexpmap'], hdu=hpxhduname) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/core.py", line 240, in read return Map.from_hdulist( File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/core.py", line 308, in from_hdulist map_type = Map._get_map_type(hdulist, hdu) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/core.py", line 339, in _get_map_type header = hdu_list[hdu_name].header File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/astropy/io/fits/hdu/hdulist.py", line 390, in getitem super().getitem, self._positive_index_of(key) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/astropy/io/fits/hdu/hdulist.py", line 857, in _positive_index_of index = self.index_of(key) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/astropy/io/fits/hdu/hdulist.py", line 839, in index_of raise KeyError(f"Extension {key!r} not found.") KeyError: "Extension 'HPXEXPOSURES' not found."

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/dell/Documents/1H1914-194/xx.py", line 4, in gta.setup() File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/fermipy/gtanalysis.py", line 1087, in setup c.setup(overwrite=overwrite) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/fermipy/gtanalysis.py", line 5198, in setup self._bexp = Map.read(self.files['bexpmap']) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/core.py", line 240, in read return Map.from_hdulist( File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/core.py", line 315, in from_hdulist return cls_out.from_hdulist( File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/wcs/core.py", line 142, in from_hdulist wcs_map = cls.from_hdu(hdu, hdu_bands, format=format) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/wcs/ndmap.py", line 88, in from_hdu geom = WcsGeom.from_header(hdu.header, hdu_bands, format=format) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/wcs/geom.py", line 485, in from_header axes = MapAxes.from_table_hdu(hdu_bands, format=format) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/axes.py", line 1962, in from_table_hdu return cls.from_table(table, format=format) File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/maps/axes.py", line 1980, in from_table from gammapy.irf.io import IRF_DL3_AXES_SPECIFICATION File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/irf/init.py", line 6, in from .background import Background2D, Background3D File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/irf/background.py", line 10, in from .core import IRF File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/irf/core.py", line 17, in from .io import IRF_DL3_HDU_SPECIFICATION, IRF_MAP_HDU_SPECIFICATION, gadf_is_pointlike File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/irf/io.py", line 4, in from gammapy.data.hdu_index_table import HDUIndexTable File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/data/init.py", line 3, in from .data_store import DataStore File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/data/data_store.py", line 15, in from .observations import Observation, ObservationChecker, Observations File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/data/observations.py", line 22, in from .event_list import EventList, EventListChecker File "/home/dell/miniconda3/envs/fermipy/lib/python3.9/site-packages/gammapy/data/event_list.py", line 8, in from astropy.coordinates.angle_utilities import angular_separation ModuleNotFoundError: No module named 'astropy.coordinates.angle_utilities'

adonath commented 8 months ago

@NithyaSathyan This issue come from Gammapy not being compatible with astropy>=6.0. Downgrading to for example astropy=5.3 should fix the problem.

NithyaSathyan commented 8 months ago

Fixed the issue.. Thank you

On Wed, 10 Jan, 2024, 1:49 am Axel Donath, @.***> wrote:

@NithyaSathyan https://github.com/NithyaSathyan This issue come from Gammapy not being compatible with astropy>=6.0. Downgrading to for example astropy=5.3 should fix the problem.

— Reply to this email directly, view it on GitHub https://github.com/fermiPy/fermipy/issues/547#issuecomment-1883720844, or unsubscribe https://github.com/notifications/unsubscribe-auth/BE6FP4N5EREKYYRHUULQJOLYNWQ6HAVCNFSM6AAAAAA22JPRSSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBTG4ZDAOBUGQ . You are receiving this because you were mentioned.Message ID: @.***>