Currently each reader has a very different structure. This complicates declaring fields within class vs using parameter file.
Proposed: If all readers have the same structure, then they can all fields can be declared in the data source class. This requires declaring reader specific attrs in the field or in the data source
Examples:
old
xlrd reader grouped by sheet with nested fields and attrs
{"sheet1": {"param1": {"range or location": "A2", "units": "meters"}}}
new
flatten nested structure by adding sheet attr to field attrs
class MyDataSource(DataSource):
param1 = {"sheet": "sheet1", "range or location":"A2", "units": "meters"}
Currently each reader has a very different structure. This complicates declaring fields within class vs using parameter file.
Proposed: If all readers have the same structure, then they can all fields can be declared in the data source class. This requires declaring reader specific attrs in the field or in the data source
Examples:
old
xlrd reader grouped by sheet with nested fields and attrs
new
flatten nested structure by adding sheet attr to field attrs