search

landsat-pds / landsat_ingestor

Scripts and other artifacts for landsat data ingestion into Amazon public hosting.
Apache License 2.0
102 stars 18 forks source link

Receiving old scenes on SNS topic #25

Closed tomtaylor closed 5 years ago

tomtaylor commented 5 years ago

I’ve just subscribed to the Landsat PDS AWS SNS feed, but it looks like I’m getting lots of old scenes through. In the last 12hrs I’ve received hundreds of events, but the most recent acquisition date is 2017-01-12.

Can anyone confirm whether this is expected behaviour? Are new scenes coming through the SNS feed at the moment?

matthewhanson commented 5 years ago

I noticed this too over the last week, but it looks like it's all pre-collection data getting updated to collection-1.

kapadia commented 5 years ago

Hi all - yes, we have ingested Collection 1 T1 data over the last week to bring the archive to a more complete form. The pre-collection data will remain. I hope this updated data is useful for others.

On Fri, Jan 25, 2019 at 7:21 AM Matthew Hanson notifications@github.com wrote:

I noticed this too over the last week, but it looks like it's all pre-collection data getting updated to collection-1.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/landsat-pds/landsat_ingestor/issues/25#issuecomment-457607361, or mute the thread https://github.com/notifications/unsubscribe-auth/AAje2St8O9dlTnvRcWVhYaigpTx_XvO1ks5vGyEVgaJpZM4aSWpa .

tomtaylor commented 5 years ago

Ah OK, that makes sense. Will we see recent acquisitions alongside those as they come in, or will those be delayed until it catches up?

kapadia commented 5 years ago

Recent acquisitions are still coming in, and being processed alongside the archive. No delay in them.

On Fri, Jan 25, 2019 at 9:38 AM Tom Taylor notifications@github.com wrote:

Ah OK, that makes sense. Will we see recent acquisitions alongside those as they come in, or will those be delayed until it catches up?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/landsat-pds/landsat_ingestor/issues/25#issuecomment-457653340, or mute the thread https://github.com/notifications/unsubscribe-auth/AAje2XA4Qdc7KZy-pd34U-VQaTQFm09Sks5vG0EHgaJpZM4aSWpa .

jflasher commented 5 years ago

Thanks Amit!

On January 25, 2019 at 17:46:34, Amit Kapadia (notifications@github.com) wrote:

Recent acquisitions are still coming in, and being processed alongside the archive. No delay in them.

On Fri, Jan 25, 2019 at 9:38 AM Tom Taylor notifications@github.com wrote:

Ah OK, that makes sense. Will we see recent acquisitions alongside those as they come in, or will those be delayed until it catches up?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub < https://github.com/landsat-pds/landsat_ingestor/issues/25#issuecomment-457653340 , or mute the thread < https://github.com/notifications/unsubscribe-auth/AAje2XA4Qdc7KZy-pd34U-VQaTQFm09Sks5vG0EHgaJpZM4aSWpa

.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/landsat-pds/landsat_ingestor/issues/25#issuecomment-457655870, or mute the thread https://github.com/notifications/unsubscribe-auth/AAz0JmndyZTHCEBaNQ6iJF3L_9tE7B7Iks5vG0L6gaJpZM4aSWpa .

tomtaylor commented 5 years ago

@kapadia thanks!