search

freifunk / vis.api.freifunk.net

Visualisation of Freifunk API data
GNU General Public License v3.0
3 stars 1 forks source link

parse JSON files instead of imported data frames #11

Closed katrinleinweber closed 8 years ago

katrinleinweber commented 8 years ago

For lots of JSONs, the current import is extremely resource hungry. Find ways to extract only relevant data per visualisation directly from the JSON files.

Even better: server-side construction of relevant CSV files as the JSONs pour in every hour.

katrinleinweber commented 8 years ago

http://zevross.com/blog/2015/02/12/using-r-to-download-and-parse-json-an-example-using-data-from-an-open-data-portal/ https://github.com/sailthru/tidyjson#tidyjson https://www.dropbox.com/s/m8o3a01wynla9ni/getting_web_data_r5_json_data.pdf?dl=0

katrinleinweber commented 8 years ago

Fixed by https://github.com/freifunk/vis.api.freifunk.net/commit/523573d8de84c53ce0ef81fc3f9da893a0d92e08.