search

SquareBracketAssociates / Booklet-DataFrame

A little booklet to master dataframe
16 stars 6 forks source link

Include examples of a full ETL pipeline #1

Open trosel opened 5 years ago

trosel commented 5 years ago

This may be outside the scope of the booklet, but there is a lack of information on how to obtain data from APIs and then format that JSON data into dataframes, and then send that off somewhere.

For example, most APIs for getting data would require some kind of oauth1 or oauth2 passed in the client.

And these APIs would most certainly give you JSON which you would need to serialize into Objects or straight into the Dataframe object.

Because in order to visualize data, we need to get it first :)

And then what do you do with the dataframe or visualization afterwards? Do you export the dataframe into a CSV and email that? Do you convert the visualization into a PDF and email that?

olekscode commented 5 years ago

Thank you for the issue and interesting questions. I will try to cover these topics in the booklet.