search

isamplesorg / export_client

Client for the iSamples export service
Apache License 2.0
1 stars 1 forks source link

Geoparquet support #5

Closed dannymandel closed 3 months ago

dannymandel commented 4 months ago

Ability to transform downloaded JSONLines files into Geoparquet. Here's full example run:

INFO 2024-05-08 15:47:04,338 Contacting the export service to start the export process
INFO 2024-05-08 15:47:04,347 Contacted the export service, created export job with uuid 302c2a2c-bf41-4c60-8034-4caefefeb520
INFO 2024-05-08 15:47:09,356 Export job still running, sleeping for 5 seconds
INFO 2024-05-08 15:47:09,371 Export job completed, going to download
INFO 2024-05-08 15:47:09,415 Successfully downloaded file to /tmp/isamples_export_2024_05_08_15_47_09.jsonl
INFO 2024-05-08 15:47:09,425 Successfully wrote manifest file to /tmp/manifest.json
INFO 2024-05-08 15:47:09,582 Successfully wrote stac item to /tmp/stac-item.json
INFO 2024-05-08 15:47:09,582 Transforming json lines file at /tmp/isamples_export_2024_05_08_15_47_09.jsonl to geoparquet
INFO 2024-05-08 15:47:15,001 Wrote geoparquet file to /tmp/isamples_export_2024_05_08_15_47_09_geo.parquet