i2mint / py2store

Tools to create simple and consistent interfaces to complicated and varied data sources.
MIT License
11 stars 2 forks source link

Use Case: Structured View of Messy Data #49

Open thorwhalen opened 4 years ago

thorwhalen commented 4 years ago

A solution: Data separating malls, that is, a store of stores that offer the clean perspectives we need.

Example.

I've often been in the situation where a client presented me with a folder containing various types of datas that were necessary for a project. Often enough, the grouping of these types of data could be made on the basis of the paths only (subfolder names, extensions, filename patterns).

For this case there's some quite obvious solution: (1) Write rules that group keys together or filter them out (2) Map the groups to some store each with their own key and value handling (3) Put it all together nicely to make general a mall that gives us the perspective we need.