AISViz / AISdb

AISdb Python package for smart AIS data storage and interaction.
https://aisviz.cs.dal.ca
GNU Affero General Public License v3.0
15 stars 1 forks source link

Save data from receiver locally #117

Open gabrielspadon opened 3 weeks ago

gabrielspadon commented 3 weeks ago

I noticed that in many cases, the processes that run remotely (receiving the data from the Raspberry) can fail for some unknown reason. I believe we should save the data locally, even if we don't have much space, just to avoid losing it. If the memory overflows, we clear the data and start storing it again.

Jinnkunn commented 3 weeks ago

Yes, we should proceed with caution, particularly because we’re using an SD card for storage. We also need to determine an optimal buffer size to limit locally stored data. If the stored data exceeds this size, older data should automatically be deleted to maintain storage efficiency.

Alternatively, if we need to store data locally for an extended period, we could add an additional storage device to the Pi to reduce frequent read-write operations on the SD card.

From: Gabriel Spadon @.> Date: Friday, November 1, 2024 at 2:49 PM To: AISViz/AISdb @.> Cc: Subscribed @.***> Subject: [AISViz/AISdb] Saver AIS data from receiver localy (Issue #117)

I noticed that in many cases, the processes that run remotely (receiving the data from the Raspberry) can fail for some unknown reason. I believe we should save the data locally, even if we don't have much space, just to avoid losing it. If the memory overflows, we clear the data and start storing it again.

— Reply to this email directly, view it on GitHubhttps://github.com/AISViz/AISdb/issues/117, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEYWT3NQU43RN6A4F4ZCF23Z6O5KZAVCNFSM6AAAAABRAV7FI6VHI2DSMVQWIX3LMV43ASLTON2WKOZSGYZDSNJWGYZDMMQ. You are receiving this because you are subscribed to this thread.Message ID: @.***>