CroatianMeteorNetwork / RMS

RPi Meteor Station
https://globalmeteornetwork.org/
GNU General Public License v3.0
169 stars 47 forks source link

Fix for platepar retrieval whilst capture is in progress #234

Closed g7gpr closed 7 months ago

g7gpr commented 7 months ago

This fix relates to issue #233.

Includes code to retrieve the platepar from the RMS root directory, often "~/source/RMS".

This is needed because the platepar file is not copied to the CapturedFiles directory until the end of capture.

g7gpr commented 7 months ago

Added a call to the database deletion routine if database corruption is detected.

g7gpr commented 7 months ago

2023/11/24 17:28:45-INFO-EventMonitor-line:1761 - Check interval is set to 3.3 minutes, however end of future event is only 1.8 minutes away 2023/11/24 17:28:45-INFO-EventMonitor-line:1767 - Check interval set to 2.2 minutes, so that future event is reported quickly 2023/11/24 17:28:45-INFO-EventMonitor-line:1925 - 1 future event is scheduled, running again at 2023-11-24 17:30:56 2023/11/24 17:28:45-INFO-EventMonitor-line:2007 - Event monitor check completed 2023/11/24 17:30:57-INFO-EventMonitor-line:1775 - Checks on trajectories for event at 20231124_173015 2023/11/24 17:30:57-INFO-EventMonitor-line:1441 - Searching for first fits file in /home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789 2023/11/24 17:30:57-INFO-EventMonitor-line:1449 - Intialised last_fits_file with /home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FF_AU001E_20231124_171258_040_0000000.fits 2023/11/24 17:30:57-INFO-EventMonitor-line:1441 - Searching for first fits file in /home/au001e/RMS_data/CapturedFiles/AU001E_20231124_170603_584519 2023/11/24 17:30:57-INFO-EventMonitor-line:1449 - Intialised last_fits_file with /home/au001e/RMS_data/CapturedFiles/AU001E_20231124_170603_584519/FF_AU001E_20231124_170613_791_0000000.fits 2023/11/24 17:30:57-INFO-EventMonitor-line:1441 - Searching for first fits file in /home/au001e/RMS_data/CapturedFiles/AU001E_20231124_112912_556421 2023/11/24 17:30:57-INFO-EventMonitor-line:1449 - Intialised last_fits_file with /home/au001e/RMS_data/CapturedFiles/AU001E_20231124_112912_556421/FF_AU001E_20231124_112920_853_0000000.fits 2023/11/24 17:30:57-INFO-EventMonitor-line:1483 - Using .config as .config file name 2023/11/24 17:30:57-INFO-EventMonitor-line:1487 - File list ['/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FF_AU001E_20231124_173001_116_0025600.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FF_AU001E_20231124_173011_362_0025856.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FF_AU001E_20231124_173021_610_0026112.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FF_AU001E_20231124_173011_362_0025856.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FF_AU001E_20231124_173031_860_0026368.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FS_AU001E_20231124_173001_116_0025600_fieldsum.bin', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FS_AU001E_20231124_173011_362_0025856_fieldsum.bin', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FS_AU001E_20231124_173021_610_0026112_fieldsum.bin', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/FS_AU001E_20231124_173031_860_0026368_fieldsum.bin', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231124_171250_272789/.config', '/home/au001e/source/RMS/platepar_cmn2010.cal'] 2023/11/24 17:30:57-INFO-EventMonitor-line:1813 - Working without standard deviations 2023/11/24 17:30:57-INFO-EventMonitor-line:1873 - Event at 20231124_173015 had 98 points out of 100 in the trajectory in the FOV. Uploading. 2023/11/24 17:30:57-INFO-EventMonitor-line:1876 - Check of trajectories took 0.244459 seconds 2023/11/24 17:30:57-INFO-EventMonitor-line:1618 - Network PO-WA and group Darkan so creating /home/au001e/RMS_data/EventMonitor/AU001E_20231124_173015_event/PO-WA/Darkan/AU001E 2023/11/24 17:30:57-INFO-EventMonitor-line:1638 - File pack (18MB) assembly started 2023/11/24 17:30:57-INFO-EventMonitor-line:1647 - File pack assembled 2023/11/24 17:30:57-INFO-EventMonitor-line:1682 - Making archive of /home/au001e/RMS_data/EventMonitor/AU001E_20231124_173015_event 2023/11/24 17:30:57-DEBUG-shutil-line:1039 - changing into '/home/au001e/RMS_data/EventMonitor/AU001E_20231124_173015_event' 2023/11/24 17:30:59-INFO-EventMonitor-line:1702 - Upload of /home/au001e/RMS_data/EventMonitor - first attempt 2023/11/24 17:31:07-INFO-UploadManager-line:207 - Copying /home/au001e/RMS_data/EventMonitor/AU001E_20231124_173015_event.tar.bz2 (7.96MB) to files/event_monitor/AU001E_20231124_173015_event.tar.bz2 2023/11/24 17:32:20-INFO-EventMonitor-line:1712 - Upload of /home/au001e/RMS_data/EventMonitor - attempt no 1 was successful 2023/11/24 17:32:20-INFO-EventMonitor-line:1716 - Now checking at 2.4 minute intervals 2023/11/24 17:32:20-INFO-EventMonitor-line:1179 - Event at 20231124_173015 marked as uploaded 2023/11/24 17:32:20-INFO-EventMonitor-line:1880 - Trajectory passed through FoV - marking 20231124_173015 as processed 2023/11/24 17:32:20-INFO-EventMonitor-line:1093 - Event at 20231124_173015 marked as processed 2023/11/24 17:32:20-INFO-EventMonitor-line:1904 - Reached end of checks - 20231124_173015 is processed 2023/11/24 17:32:20-INFO-EventMonitor-line:1907 - Check of trajectories time elapsed 83.58 seconds 2023/11/24 17:32:20-INFO-EventMonitor-line:1920 - 1 event was processed, EventMonitor work completed 2023/11/24 17:32:20-INFO-EventMonitor-line:2007 - Event monitor check completed

g7gpr commented 7 months ago

And a check of the reporting for events from previous capture directories, pulls the platepar file from the CapturedFiles directory

2023/11/24 17:34:50-INFO-EventMonitor-line:1483 - Using .config as .config file name 2023/11/24 17:34:50-INFO-EventMonitor-line:1487 - File list ['/home/au001e/RMS_data/CapturedFiles/AU001E_20231120_112512_840979/FF_AU001E_20231120_124921_883_0125952.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231120_112512_840979/FF_AU001E_20231120_124932_131_0126208.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231120_112512_840979/FF_AU001E_20231120_124942_352_0126464.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231120_112512_840979/FF_AU001E_20231120_124932_131_0126208.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231120_112512_840979/FF_AU001E_20231120_124952_641_0126720.fits', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231120_112512_840979/.config', '/home/au001e/RMS_data/CapturedFiles/AU001E_20231120_112512_840979/platepar_cmn2010.cal'] 2023/11/24 17:34:50-INFO-EventMonitor-line:1813 - Working without standard deviations 2023/11/24 17:34:50-INFO-EventMonitor-line:1873 - Event at 20231120_124940 had 98 points out of 100 in the trajectory in the FOV. Uploading. 2023/11/24 17:34:50-INFO-EventMonitor-line:1876 - Check of trajectories took 0.216221 seconds 2023/11/24 17:34:50-INFO-EventMonitor-line:1618 - Network PO-WA and group Darkan so creating /home/au001e/RMS_data/EventMonitor/AU001E_20231120_124940_event/PO-WA/Darkan/AU001E 2023/11/24 17:34:50-INFO-EventMonitor-line:1638 - File pack (18MB) assembly started 2023/11/24 17:34:50-INFO-EventMonitor-line:1647 - File pack assembled 2023/11/24 17:34:51-INFO-EventMonitor-line:1682 - Making archive of /home/au001e/RMS_data/EventMonitor/AU001E_20231120_124940_event 2023/11/24 17:34:51-DEBUG-shutil-line:1039 - changing into '/home/au001e/RMS_data/EventMonitor/AU001E_20231120_124940_event' 2023/11/24 17:34:53-INFO-EventMonitor-line:1702 - Upload of /home/au001e/RMS_data/EventMonitor - first attempt 2023/11/24 17:35:00-INFO-UploadManager-line:207 - Copying /home/au001e/RMS_data/EventMonitor/AU001E_20231120_124940_event.tar.bz2 (7.88MB) to files/event_monitor/AU001E_20231120_124940_event.tar.bz2