search

max-mapper / datacouch

[ON HIATUS] distributed, collaborative dataset sharing
122 stars 12 forks source link

Implement common data enhancements as transformations #14

Open mpictor opened 13 years ago

mpictor commented 13 years ago

Implement common data enhancements as transformations, so that they can be easily applied to the original data set when it is updated.

For example - City A uploads crime data, where one field is IN ALL CAPS. User B painstakingly rewrites this field as lowercase, except for the first letter. City A appends newer data. Now, part of the data is Pretty and part of it is UGLY. Unless User B goes back and updates the data again, it will be in mixed formats - and that would be an abomination.

If there was a way to specify the desired transformation, it could be automatically applied every time the data was uploaded (assuming the uploader approved the transformation).

Specifying a transform:

(Forgive me if this feature exists or is in the works - I saw the video on CfA and this idea popped into my head)

Keep up the good work!

max-mapper commented 12 years ago

@mpictor this is getting closer to reality now that transformations happen on the server side (so i can support transforming whenever data changes on the server now)