This PR augments existing functionality to download Gaia files (DR2/EDR3) to add Gaia DR3. Changes are fairly minimal, and are mostly to handle new Gaia syntax, so I'll self-merge in a day or two.
The only major addition is an option to "mop up" files when converting between the scraped Gaia csv files and FITS files (in the gaia_csv_to_fits() function). It's now possible to run that conversion piecemeal, which is convenient as it takes a little over 4 hours on an interactive node to process all of the Gaia DR3 files.
This PR augments existing functionality to download Gaia files (DR2/EDR3) to add Gaia DR3. Changes are fairly minimal, and are mostly to handle new Gaia syntax, so I'll self-merge in a day or two.
The only major addition is an option to "mop up" files when converting between the scraped Gaia csv files and FITS files (in the
gaia_csv_to_fits()function). It's now possible to run that conversion piecemeal, which is convenient as it takes a little over 4 hours on an interactive node to process all of the Gaia DR3 files.