Open j08lue opened 1 month ago
To try something new, I just uploaded these files to the staging bucket:
s3://veda-data-store-staging/geoglam/CropMonitor_202409.tif
s3://veda-data-store-staging/geoglam/CropMonitor_202410.tif
@smohiudd or @anayeaye, can you please check whether these files get picked up automatically from there?
Btw, I also by uploaded a file to this key: s3://veda-data-store-staging/veda-data-store-staging/geoglam/CropMonitor_202410.tif
(note the double veda-data-store-staging
). I do not have permission to aws s3 rm
it. Can you do that, please?
Good illustration that folks need guardrails around which buckets / key structure they would be allowed to touch, if we create a simple interface for this... 🤦
Thanks @j08lue!
@sandrahoang686 can you check that these are getting ingested using the automated ingest we just set up?
Btw, there are some files with inconsistent naming.
$ aws s3 ls s3://veda-data-store-staging/geoglam/
2023-06-14 17:04:20 6148 .DS_Store
2023-06-14 17:04:20 6012504 CropMonitor_202001.tif
2023-06-14 17:04:20 6029419 CropMonitor_202002.tif
2023-06-14 17:04:20 6017018 CropMonitor_202003.tif
2023-06-14 17:04:20 6386366 CropMonitor_202004.tif
2023-06-14 17:04:20 6346561 CropMonitor_202005.tif
2023-06-14 17:04:20 6320955 CropMonitor_202006.tif
2023-06-14 17:04:20 4658995 CropMonitor_202007.tif
2023-06-14 17:04:20 4677472 CropMonitor_202008.tif
2023-06-14 17:04:20 4705830 CropMonitor_202009.tif
2023-06-14 17:04:20 4341809 CropMonitor_202010.tif
2023-06-14 17:04:24 5288105 CropMonitor_202011.tif
2023-06-14 17:04:24 5321207 CropMonitor_202101.tif
2023-06-14 17:04:24 5277308 CropMonitor_202102.tif
2023-06-14 17:04:24 5284661 CropMonitor_202103.tif
2023-06-14 17:04:24 5259615 CropMonitor_202104.tif
2023-06-14 17:04:24 5239591 CropMonitor_202105.tif
2023-06-14 17:04:24 4492889 CropMonitor_202106.tif
2023-06-14 17:04:24 4503863 CropMonitor_202107.tif
2023-06-14 17:04:24 3494043 CropMonitor_202108.tif
2023-06-14 17:04:24 5293999 CropMonitor_202109.tif
2023-06-14 17:04:26 5343006 CropMonitor_202110.tif
2023-06-14 17:04:26 5311489 CropMonitor_202111.tif
2023-06-14 17:04:26 5336762 CropMonitor_202201.tif
2023-06-14 17:04:26 5268139 CropMonitor_202202.tif
2023-06-14 17:04:26 5309246 CropMonitor_202203.tif
2023-06-14 17:04:26 5281256 CropMonitor_202204.tif
2023-06-14 17:04:26 4886345 CropMonitor_202205.tif
2023-06-14 17:04:26 4907825 CropMonitor_202206.tif
2023-06-14 17:04:26 4946370 CropMonitor_202207.tif
2023-06-14 17:04:26 3296784 CropMonitor_202208.tif
2023-06-14 17:04:27 4996502 CropMonitor_202209.tif
2023-06-14 17:04:27 5006583 CropMonitor_202210.tif
2023-06-14 17:04:27 5036055 CropMonitor_202211.tif
2023-06-14 17:04:27 4968798 CropMonitor_202304.tif
2023-07-19 14:39:19 4693854 CropMonitor_202305.tif
2023-08-24 13:40:42 5013383 CropMonitor_202306.tif
2023-11-03 13:05:31 5411525 CropMonitor_202307.tif
2023-11-03 13:06:38 5362108 CropMonitor_202308.tif
2023-11-07 20:32:14 4678356 CropMonitor_202309.tif
2023-11-07 20:31:23 4723276 CropMonitor_202310.tif
2024-02-09 03:17:38 4800011 CropMonitor_202311.tif
2023-06-14 17:04:27 4982767 CropMonitor_2023_01_28.tif
2023-06-14 17:04:27 4973021 CropMonitor_2023_02_28.tif
2023-06-14 17:04:27 5016336 CropMonitor_2023_03_28.tif
2024-02-09 03:21:04 5003250 CropMonitor_202401.tif
2024-03-14 18:56:23 4753596 CropMonitor_202402.tif
2024-04-25 18:43:51 4795250 CropMonitor_202403.tif
2024-06-03 23:27:29 4792191 CropMonitor_202404.tif
2024-06-20 14:02:41 4819082 CropMonitor_202405.tif
2024-08-02 13:31:59 4807514 CropMonitor_202406.tif
2024-08-02 13:32:52 4822375 CropMonitor_202407.tif
2024-11-06 21:11:27 4791300 CropMonitor_202408.tif
2024-11-07 22:10:10 4812414 CropMonitor_202409.tif
2024-11-07 22:09:06 4837923 CropMonitor_202410.tif
2024-11-06 21:08:00 4791300 Global_Synthesis_2024_08_28.tif
2024-11-06 21:04:43 3678153 Global_Synthesis_2024_08_28.zip
The 2023-01 through 2023-03 ones are the only files available for those months, so maybe these have been ingested all the way into STAC?.
The GLobal_Synthesis_2024-08-28.*
files can go.
Like #167
Link to data: