As an etlhelper user I want tuple and list row factories to allow data transfer in other native Python containers.
Description
The DBAPI default is for database rows to be returned as tuples. ETL Helper provides namedtuple and dictionary row factories to give more convenient access to data e.g. via column names. However, both of these methods require some transformation of data on the ETL Helper machine.
A tuple row factory would minimise data processing and therefore represents a possible speed-up on transfers. A list row factory gives a lightweight container that is also mutable. Mutable containers allow for simpler transform functions as they can be altered in place.
Mutable
Immutable
Positional access
list
tuple
Name access
dict
namedtuple
Acceptance criteria
[ ] list_row_factory and tuple_row_factory are created
Summary
As an etlhelper user I want tuple and list row factories to allow data transfer in other native Python containers.
Description
The DBAPI default is for database rows to be returned as tuples. ETL Helper provides namedtuple and dictionary row factories to give more convenient access to data e.g. via column names. However, both of these methods require some transformation of data on the ETL Helper machine.
A tuple row factory would minimise data processing and therefore represents a possible speed-up on transfers. A list row factory gives a lightweight container that is also mutable. Mutable containers allow for simpler transform functions as they can be altered in place.
Acceptance criteria
list_row_factoryandtuple_row_factoryare created