search

keplergl / kepler.gl

Kepler.gl is a powerful open source geospatial analysis tool for large-scale data sets.
http://kepler.gl
MIT License
10.44k stars 1.75k forks source link

Support geojsonl (new line delimited geojson data) #867

Open josiekre opened 4 years ago

josiekre commented 4 years ago

It would be nice to have Kepler.gl support newline delimited geojson (geojsonl, https://www.interline.io/blog/geojsonl-extracts/) directly.

Mapbox's Tippecanone does, along with some others.

ibgreen commented 4 years ago

@josiekre Hi, that looks like a useful format.

By coincidence, I just got the initial version of the general streaming JSONLoader in loaders.gl working today - it supports streaming parsing from standard GeoJSON (i.e. removes the need to reformat existing geojson files to geojsonl to support large files).

The goal is to integrate the loaders.gl loaders in kepler.gl. Ideally we can expand the @loaders.gl/json module to also support the geojsonl format, giving the user the best of both worlds.

RandomFractals commented 4 years ago

ouch! there is geojsnl too? you guys should talk ... https://github.com/json5/json5/issues/190#issuecomment-557482212

RandomFractals commented 4 years ago

@heshan0131 & @ibgreen hi guys, this looks interesting. Any plans to integrate it into kepler.gl soon?

I know many devs use jsonl for logs in json format.

This solution is kind of like that but for larger geo data files.

I'd love to integrate it into my map tool for vscode devs.

Let me know how far away you are from embedding it in kepler.gl.

davidcalhoun commented 2 years ago

loaders.gl now supports ndgeojson so it would be great to see support for file extensions .ndgeojson, .geojsonl, and .ldgeojson as well!