search

citruspi / RHoKTheHood

A system for visualizing census data over the City of Rochester.
https://rhokthehood.com
MIT License
4 stars 2 forks source link

Save what filters are looked at #15

Open thequbit opened 10 years ago

thequbit commented 10 years ago

It would be great to generate statistics to see what filters people are looking at the most. This could then be filtered upstream to politicians so they know what is important to their citizens.

This would, of course, need the project to include a database. I suggest MongoDB.

citruspi commented 10 years ago

@thequbit,

This should be simple to do with some analytics. Should we also record the location being viewed with the filter? That is, record "Rochester - Violent Crime Rate," not just "Violent Crime Rate." That way we can see what people in different locations are interested in viewing.

It was mentioned to me that because we're using CSV for the statistic source right now, we should go with Postgres because a CSV represents a "table" - relational data. If it doesn't work out, we can always switch to MongoDB, but I've asked someone to look into, and start working on, Postgres integration.

— @citruspi

thequbit commented 10 years ago

I would recommend converting all of the csv files to json. It will load faster and be more portable.

It also removes an entire layer of conversation if going to a NoSQL database.

As for saving statistics I would try and capture as much as possible. If we could pull IP statistics to see if it is someone from the area that would be extremely useful as well.

Those would be the big three. I'm confident we could capture additional meta data as well.

citruspi commented 10 years ago

@thequbit,

I'm planning on converting the CSV to JSON at some point in the near future, when I have time to convert the statistics file(s) and rewrite the Javascript that's processing it.

As for the analytics, I'd be interested in saving stuff like the filter viewed, location viewed, and location visiting from (IP location). But I'd prefer not to record the IP address itself or any other identifying information. Would you also want to track the amount of time spent on each filter (i.e. level of interest in each filter)?

— @citruspi

thequbit commented 10 years ago

I was going to explicitly say I didn't want to collect IPs or any additional IP information in my response but forgot. I agree that we should not be collecting any information outside of location from visitors.

Duration could be cool as well. I think getting the reports right will be the challenging part ha. I say we just keep a running list of 'shall have' and 'may have' items on what to track and what not to track.

citruspi commented 10 years ago

@thequbit,

Definitely. I have some ideas for getting the reports which I'll explore when I have some time.

Another thing we should definitely keep track of is devices being used - if we're getting a significant amount of mobile traffic, we would want to make sure that we spend more time enhancing the mobile experience.

— @citruspi