search

jTaylo99 / kolumnextractor

A data extractor designed around building your requirements and easily extracting and verifying your data.
4 stars 8 forks source link

Handle options for multiple names for a column #5

Open rphilip457 opened 2 years ago

rphilip457 commented 2 years ago

A common issue with reading data from multiple data source is that column names can often change but the data within remains somewhat similar. Handling this somewhere in the Data class would be useful.

geoffleyland commented 1 year ago

In addition, allow different transformations for different names: if a column is "length_m" then the transform would just turn the string input to a float. If the column title is "length ft", then the transform might want to transform the string to a number and then divide it by 3.28. (There's potential for some really nice transformation mechanisms through function composition)