read_header cannot open None issue

[DavidT3]

This is happening more and more often and I don't understand why - was analysing a bunch of clusters, that I had declared before, which generated a bunch of a images etc, then I encountered a problem, redeclared with cleaning turn on, and then we get this:

Exception: [FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-73 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-57 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-62 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-197 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-147 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-110 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-120 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-29 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-125 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-148 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-41 is the associated source, the specific data used is combined-combined."), FileNotFoundError("FITSIO read_header cannot open None, possibly because there is a problem with the file, it doesn't exist, or maybe an SFTP problem? This product is associated with None.- ACCEPT-200 is the associated source, the specific data used is combined-combined.")]

Caused by the call to emosaic in ClusterSample.

Really no idea why this is happening unfortunately

[DavidT3]

So the emosaic runs are not working because there are no images being passed in, but they are failing with a totally unrelated error:

* emosaic: error (projectionNotYetSupported), ssclib:pixelsToTanVector: Non-TAN projections are not yet supported. mv: cannot stat ‘’: No such file or directory

And then of course there is a bash error because the expected file doesn't exist.

I'll add the projectionNotYetSupported error to my index, and then move on to figuring out why no images are being passed.

[DavidT3]

I randomly sampled down to 10 entries to make the tests I was doing faster - and that seemed to mean this error just never pops up??

[DavidT3]

So, interestingly, for ACCEPT-120 (ABELL 3266) the following data are being selected; 0105262401pn. That is odd, because the dataset doesn't seem to have any PN data for that ObsID.

The entry for the census is true for PN (which is obviously outdated) but I still don't understand how it was even selected if there is no event list.

This ObsID doesn't even seem to have an entry on XSA anymore

[DavidT3]

The plot thickens/gets even weirder - this is the state of the _products dictionary at the end of initial_products:

{'mos1': {'events': <xga.products.misc.EventList object at 0x2b7bbcc07ad0>, 'bound_0.5-2.0': {}, 'bound_2.0-10.0': {}}, 'mos2': {'events': <xga.products.misc.EventList object at 0x2b7bb7e8f590>, 'bound_0.5-2.0': {}, 'bound_2.0-10.0': {}}}

THERE IS NO ENTRY FOR PN, so somehow it's hallucinating at some point that there is PN available

[DavidT3]

This is sorted - closing now