search

jorge3fernandes / City_of_Brockton_R

This repo documents the impact of data science in city through the use of police dispatch log.
https://jorgefernandes.shinyapps.io/Brockton_Police_Dispatch/
2 stars 1 forks source link

Decide on how to manage the data #13

Open jorge3fernandes opened 6 years ago

jorge3fernandes commented 6 years ago

@sconde I was thinking since we will probably expand this to other towns, we should consider how we will be managing the data. I was looking on developing a star schema model, or we could just keep it as a flat table.

sconde commented 6 years ago

@jorge3fernandes can you give more info on this, e.g. reading lists please

jorge3fernandes commented 5 years ago

We need to normalize the data and index the tables to speed up the queries.

sconde commented 5 years ago

We need to normalize the data and index the tables to speed up the queries

what database do you have in mind?

jorge3fernandes commented 5 years ago

Not sure yet. For now I'll just create the script and store the tables as csv.

sconde commented 5 years ago

yea. raw csv is fine for now. Or you can store them as pickle. Later we can look into MongoDB

JavierGalindo91 commented 5 years ago

What's going on here guys? Jorge, what is your goal with this?

On Mon, Mar 25, 2019 at 8:02 AM Sidafa Conde notifications@github.com wrote:

yea. raw csv is fine for now. Or you can store them as pickle. Later we can look into MongoDB

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/jorge3fernandes/City_of_Brockton_R/issues/13#issuecomment-476166842, or mute the thread https://github.com/notifications/unsubscribe-auth/AQRLujWnZ8kkZAFjNEq5M_kWXsMk3naCks5vaLrVgaJpZM4RCYmn .

jorge3fernandes commented 5 years ago

@JavierGalindo91, Check read me. Just trying to see how to best store the data scraped

sconde commented 5 years ago

since when did @JavierGalindo91 start using git