CartoDB / carto-python

CARTO Python client
https://carto.com
BSD 3-Clause "New" or "Revised" License
154 stars 62 forks source link

Add NEXRAD COPY example #93

Closed rafatower closed 6 years ago

rafatower commented 6 years ago

This is an example about how to use the CopySQLClient to stream data from an external service, in this case NEXRAD Level 2 radar data, to a CARTO table.

I created it in a separate directory, in order not to pollute the dependencies of the other examples, cause it requires numpy and siphon (which in turns requires pandas) and those packages need native dependencies that might be tricky to get installed.

rafatower commented 6 years ago

Could you please take a final look?

PS: sorry, I forgot to push a commit :S

rafatower commented 6 years ago

da visual test:

INFO:nexrad_copy:Avaliable datasets: ['Level2_KLVX_20180822_1657.ar2v']
INFO:nexrad_copy:Using the first one
INFO:nexrad_copy:Got the following data: Nexrad Level 2 Station KLVX from 2018-08-22T16:57:27Z to 2018-08-22T17:01:59Z
INFO:nexrad_copy:Weather Surveillance Radar-1988 Doppler (WSR-88D) Level II data are the three meteorological base data quantities: reflectivity, mean radial velocity, and spectrum width.

image

vs

https://radar.weather.gov/radar.php?rid=lvx

image

alrocar commented 6 years ago

I randomly found this on Tw

Could it be a good occasion to showcase this example in a blog post?

CCing @makella

makella commented 6 years ago

YES! i can help with some of the cartography/styling if you guys want!!

rafatower commented 6 years ago

:open_mouth: yes, please, of course!

Actually I'm writing a post about the python SDK and the copy right now and a couple assets will be more than welcomed. Kind of in a rush, cause tomorrow I'll be :beach_umbrella:

Edit: probably talking about different posts

makella commented 6 years ago

@rafatower is there some data you can pass me? i'll see if i can do something quickly :)

makella commented 6 years ago

Edit: probably talking about different posts

Ah! missed this! ok, let me know i would love to work on symbolizing some of the radar data!!!