PickwickSoft / pystreamapi

The Python Stream API Library offering Streams like you know from Java/Kotlin/Scala in Python with some cool extensions
https://pystreamapi.pickwicksoft.org/
GNU General Public License v3.0
30 stars 5 forks source link

Data loader for YAML #71

Closed garlontas closed 5 months ago

garlontas commented 1 year ago

YAML data loader

Currently, we have a data loader for CSV files. It works by converting each data set (each row) to a namedtuple.

We need sth similar for YAML. Note that type conversion should be done as efficient as possible (see issue #63 for more information).

The loader should also handle non-consistent data, such as the YAML below:

- name: Joe Doe
  position: Vice President
  children:
    - name: Jim Doe
    - name: Kim Doe
- class: Mammalia
  order: Carnivora
  family: Canidae
  genus: Canis

Here, a LazyFileIterable containing two differently structured namedtuples should be created.

You can view the implementation for CSV here.

You can view the issue for the JSON loader here: #70