PickwickSoft / pystreamapi

The Python Stream API Library offering Streams like you know from Java/Kotlin/Scala in Python with some cool extensions
https://pystreamapi.pickwicksoft.org/
GNU General Public License v3.0
30 stars 5 forks source link

Data loader for TOML #73

Open garlontas opened 1 year ago

garlontas commented 1 year ago

TOML data loader

Currently, we have a data loader for CSV files. It works by converting each data set (each row) to a namedtuple.

We need sth similar for TOML. Note that type conversion should be done as efficient as possible (see issue #63 for more information).

The loader should also handle non-consistent data, such as the TOML below:

[[employees.employee]]
name = "John Doe"
position = "Software Engineer"
salary = 80_000
children = 2

[[employees.employee]]
name = "Alice Smith"
position = "Network Administrator"
salary = 75_000
children = 1

[[employees.employee]]
name = "Bob Johnson"
experience = "Database"
wage = 82_000
car = "Audi"

Here, a LazyFileIterable containing three differently structured namedtuples should be created.

You can view the implementation for CSV here

You can view the issue for the JSON loader here: #70

You can view the issue for the YAML loader here: #71

You can view the issue for the XML loader here: #72