covid19india / covid19india-react

Tracking the impact of COVID-19 in India
https://www.covid19india.org
MIT License
6.86k stars 3.41k forks source link

Use data from Google Mobility Reports to show movement activity #647

Closed pastelsky closed 4 years ago

pastelsky commented 4 years ago

Is your feature request related to a problem? Please describe. Firstly, I love the way this project has scaled up, and thanks for all of your efforts in managing it.

Google started publishing mobility reports for countries (including India) that showcase public activity at different social gathering points like parks, retail stores etc.

image

While Google hasn't released machine-readable data for this, I've managed to extract out values from vectors embedded in these pdf reports into an API which I plan to keep updated –

https://github.com/pastelsky/covid-19-mobility-tracker

I think this is useful information that you might want to add to the site.

Describe the solution you'd like Since the raw form data is available as a time-series, these can be interactive graphs that is shown on the site.

If you think this is worth adding, I'd be happy to work on it :)

sudevschiz commented 4 years ago

This would be a nice project for the deep-dive team.

jeremyphilemon commented 4 years ago

This looks good, great work on the reverse-engineered API haha! Would you like to work on this?

We can have a discussion over how we can include this and get started! Something like an ELI5 also would be nice explaining what the values mean, and how we could represent the data meaningfully :)

pastelsky commented 4 years ago

Sure. I am a front-end guy who's done some data viz and would love to help with this.

For India, specifically, Google hasn't released state level data yet, which would've made things more interesting – but unlike US, since ours is a national lockdown this still gives a decent picture.

Something like this would become even more useful if the lockdown is partially lifted after Apr 14th (assuming Google keeps publishing updates till then).

There are 6 different social gathering points, so these can be shown as such – alt

These can also be presented in a more processed manner –

1) Presenting only the daily rise and fall instead of a time series.

2) Comparing leisure (parks, recreation, transit) vs essential (grocery & pharmacy) vs residential.

Or maybe even a comparison of India with other countries? Global comparisons can help add perspective – for eg our abysmal testing rates but lesser social activity due to a better lockdown.

What sort of presentation were you looking at with ELI5?

faisal3389 commented 4 years ago

@pastelsky I would like to help you with this. Let me know if I also contribute to this.

jeremyphilemon commented 4 years ago

@pastelsky Ah I understand now, I think this would be good to be featured in the deep dive section right now. This is what's next in the pipeline. Can you work on an initial build for a preview? That way I'd be able to give suggestions and help with the iterative updates on it :)

@faisal3389, sure you can have a conversation with @pastelsky and see if you can work on it together!

kunalpgithub commented 4 years ago

This will be cool feature, let me know if you need any help with front end.

pastelsky commented 4 years ago

@faisal3389 @kunalpgithub I've posted a rough sketch of how this can look on a mobile device. The data sources are linked in this thread. I think this can be divided into two independent streams –

  1. Creation of the tabbed UI with placeholder content & and adding code for API calls for the API I've created.

  2. Charting of the data & insights from the API.

I'm happy to provide more high-fidelity mocks keeping in line with the current design guidelines. @faisal3389 / @kunalpgithub could you please pick one that seems most interesting to you?

@jeremyphilemon Could you help me understand what you mean when you refer to "deep-dive" section?

faisal3389 commented 4 years ago

@pastelsky sure, I would like to help out, I can create the tabbed UI.

Just to reverify my understanding of the feature, we are adding a new page to the current app, which will show the reports and will be using the APIs from https://github.com/pastelsky/covid-19-mobility-tracker.

swingcake commented 4 years ago

@pastelsky AFAIK this is what they've been referring to as "deep-dive".

kunalpgithub commented 4 years ago

I am late to respond, is anything started on this @faisal3389. I can help with front end back end both.

pastelsky commented 4 years ago

This week looks busy for me, so I haven't been able to make any progress. I've synced the mobility data with the latest available update from google. Now that the deep dive section is live on the site, I think both of you can get started on the tabbed UI & the graph.

I'll try to join the effort this weekend.

On Mon, Apr 13, 2020 at 10:02 PM Krunal Parmar notifications@github.com wrote:

I am late to respond, is anything started on this @faisal3389 https://github.com/faisal3389. I can help with front end back end both.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/covid19india/covid19india-react/issues/647#issuecomment-612976365, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACEIEH6SUQ7OEJ5NENSDEITRMM5CTANCNFSM4L6VNTXA .

-- Regards, Shubham Kanodia

kunalpgithub commented 4 years ago

@pastelsky assign this to me, I have some time in this week. I understand we need to display mobility report data for india in graph. Both as time series and single day up/down.

Do we need tabbed UI for entire Deep dive page or just for mobility report?

Correct me if anything wrong.

faisal3389 commented 4 years ago

@kunalpgithub I could not get any work done on this feature. Sure, you can start working on this. For starters, you can push an empty tabbed UI page then we can add more features and API integration to it.

bootleg-icarus commented 4 years ago

@faisal3389 I added the charts based on the api, please take a look. Here's the code

I'm working on the styling now, I know it is not yet responsive and the spaces seem a bit odd.

Sample for the new charts

kunalpgithub commented 4 years ago

@bootleg-icarus @faisal3389 I can add tabbed ui to this. Meanwhile it will be good if someone apply appropriate label to issue.

bootleg-icarus commented 4 years ago

@kunalpgithub the tabbed ui is done too, you might be able to see that in the picture. If you want to see any changes, please let me know.

@pastelsky please check if this is the feature you wanted. Also, I got a couple of the questions about the API,

  1. Does the API update everyday if google releases new data?
  2. Will it always have 50 data points for each of those metrics? And thank you for the API, great work work there.
kunalpgithub commented 4 years ago

@bootleg-icarus yes I saw tabs after settimg up branch, anyways let me know if needed anything. I will find something else.

MesumRaza commented 4 years ago

Hey just wanted to specially appreciate and thanks for this wonderful work, I have setup a basic analysis for Pakistan and will be releasing World wide interactive kit for the same dataset.

The link is http://hyperurl.co/pakcovid I have combined all your country data into one.

faisal3389 commented 4 years ago

@faisal3389 I added the charts based on the api, please take a look. Here's the code

I'm working on the styling now, I know it is not yet responsive and the spaces seem a bit odd.

Sample for the new charts

@bootleg-icarus good work on the tabbed-UI, this looks great. I have a suggestion, It would be more meaningful if the y-axis displays the percentage instead of absolute numbers as represented by the API. @pastelsky can comment on the further features that are planned.

bootleg-icarus commented 4 years ago

@faisal3389 I made some changes. Please take a look

covid19

@pastelsky @sudevschiz @jeremyphilemon Could you assign this to me?

stale[bot] commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.