search

SIMPLE-AstroDB / SIMPLE-db

BSD 3-Clause "New" or "Revised" License
11 stars 22 forks source link

Fix broken 4 spectra links #413

Open kelle opened 1 year ago

kelle commented 1 year ago

There are 30 spectra which are giving 404 errors.

tests/scheduled_checks.py found 39 broken spectra urls: ['https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS1503%2B2525_SL.txt', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U40068_0534-0631.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20989_n3.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20989_n4.fits', 'https://bdnyc.s3.amazonaws.com/IRS/2MASS+J22541892%2B3123498.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U21010.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20976.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/u12003.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U40106_0406-3812.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U21011.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U21018.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U51060_1302%2B5650_notell.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20993_2315%2B0617.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U21001.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U21009.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U50933_1118-0856_K10.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U40005_2249%2B0044.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20909.fits', 'https://s3.amazonaws.com/bdnyc/RCspec%20%28CTIO%204m%29/L1_OPT_2MASS_J10595138-2113082_Cruz2003.txt', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U21005.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20990.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20994.fits', 'https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/vB10_SL.txt', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U11993.fits', 'https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS1615%2B3558_SL.txt', 'https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS1658%2B7027_SL.txt', 'https://bdnyc.s3.amazonaws.com/XShooter/J11123099-7653342.txt', 'https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS0036%2B1821_SL.txt', 'https://bdnyc.s3.amazonaws.com/IRS/0000%252B2554_IRS_spectrum.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U40021_roque25_davy.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20907.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U40018_ppl1_davy.fits', 'https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS0746%2B2000AB_SL.txt', 'https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/BRI0021-0214_SL.txt', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20979.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U20906.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U21002.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U21004.fits', 'https://s3.amazonaws.com/bdnyc/optical_spectra/U50174_1331-0116_Hawley02.fits'],

kelle commented 9 months ago

Next step: See if any of these files exist in the shared BDNYC_spectra folder.

LishaRamon commented 9 months ago

Found in BDNYC_spectra- https://s3.amazonaws.com/bdnyc/optical_spectra/U40068_0534-0631.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U20989_n3.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U21010.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U20976.fits https://s3.amazonaws.com/bdnyc/optical_spectra/u12003.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U40106_0406-3812.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U21011.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U21018.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U21001.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U21009.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U50933_1118-0856_K10.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U40005_2249%2B0044.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U20909.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U21002.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U21004.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U40021_roque25_davy.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U20907.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U40018_ppl1_davy.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U21005.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U20990.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U20994.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U11993.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U20993_2315%2B0617.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U51060_1302%2B5650_notell.fits https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/vB10_SL.txt https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS1615%2B3558_SL.txt https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS1658%2B7027_SL.txt https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS0036%2B1821_SL.txt https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS0746%2B2000AB_SL.txt https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/BRI0021-0214_SL.txt https://s3.amazonaws.com/bdnyc/IRS/IRS_DimSuns_S12/2MASS1503%2B2525_SL.txt

Not Found in BDNYC_spectra- https://s3.amazonaws.com/bdnyc/optical_spectra/U20989_n4.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U20979.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U20906.fits https://s3.amazonaws.com/bdnyc/optical_spectra/U50174_1331-0116_Hawley02.fits https://bdnyc.s3.amazonaws.com/IRS/2MASS+J22541892%2B3123498.fits https://bdnyc.s3.amazonaws.com/IRS/0000%252B2554_IRS_spectrum.fits https://bdnyc.s3.amazonaws.com/XShooter/J11123099-7653342.txt https://s3.amazonaws.com/bdnyc/RCspec%20%28CTIO%204m%29/L1_OPT_2MASS_J10595138-2113082_Cruz2003.txt

kelle commented 9 months ago

I uploaded all of the "Found" sources and I also found all of the optical_spectra/ ones in "Not Found". I think that leaves only 4 left. Will double check with the scheduled_checks script.

kelle commented 9 months ago

Here are the 4 left which need deeper investigation: