Data loading

[SodaVolcano]

---

Title: "Closes issue #22 " About: Function to load PSV files and tests Labels: '' Assignees: ''

---

What does this implement/fix? Explain your changes.

Adds 2 functions to load a directory of PSV files and output a dictionary of LazyFrames

• Removes data sync script

Checklist:

• [x] My code follows the code style of this project.
• [x] I have performed a self-review of my own code.
• [x] I have commented on my code, particularly in hard-to-understand areas.
• [x] I have made corresponding changes to the documentation.
• [x] My changes generate no new warnings.
• [x] I have added tests that prove my fix is effective or that my feature works.
• [x] New and existing unit tests pass locally with my changes.
• [x] Any dependent changes have been merged and published in downstream modules.

[Reece030130]

Census data contains .csv files. which will be filtered when read_all_psv. and xlsx files. Do we need read_all_csv......

[SodaVolcano]

Census data contains .csv files. which will be filtered when read_all_psv. and xlsx files. Do we need read_all_csv......

I've added support for csv and xlsx, function is now called read_spreadsheets. I didn't add error checking because that'll muddy up the code and the return type, I'm assuming the user can use the function properly.

btw if there's a functionality you think should be added to a PR or be made into a new issue, you can request change by re-reviewing the branch or make a new issue.