Open garlontas opened 1 year ago
Currently, we have a data loader for CSV files. It works by converting each data set (each row) to a namedtuple.
namedtuple
We need sth similar for TOML. Note that type conversion should be done as efficient as possible (see issue #63 for more information).
The loader should also handle non-consistent data, such as the TOML below:
[[employees.employee]] name = "John Doe" position = "Software Engineer" salary = 80_000 children = 2 [[employees.employee]] name = "Alice Smith" position = "Network Administrator" salary = 75_000 children = 1 [[employees.employee]] name = "Bob Johnson" experience = "Database" wage = 82_000 car = "Audi"
Here, a LazyFileIterable containing three differently structured namedtuples should be created.
LazyFileIterable
namedtuples
You can view the implementation for CSV here
You can view the issue for the JSON loader here: #70
You can view the issue for the YAML loader here: #71
You can view the issue for the XML loader here: #72
TOML data loader
Currently, we have a data loader for CSV files. It works by converting each data set (each row) to a
namedtuple
.We need sth similar for TOML. Note that type conversion should be done as efficient as possible (see issue #63 for more information).
The loader should also handle non-consistent data, such as the TOML below:
Here, a
LazyFileIterable
containing three differently structurednamedtuples
should be created.You can view the implementation for CSV here
You can view the issue for the JSON loader here: #70
You can view the issue for the YAML loader here: #71
You can view the issue for the XML loader here: #72