SFOE / OGD_qualitychecks

Automated pipeline to check OGD data quality using Frictionless
0 stars 0 forks source link

Extract ogd #10

Closed aresssera closed 1 year ago

aresssera commented 1 year ago

First, I added the function to extract the ogd id (#3) from the file name. To test everything I added more files to the staging folder and realized, that the previous function, which gets the file names, did not properly work. That's why this code includes #1 too.

When running the main.py script, a file info.csv is saved in the files folder. It contains the file names + corresponding ogd id's. The file is for testing purposes only. To mention: A consisting file cannot be overwritten, only a new one can be created.

AFoletti commented 1 year ago

This LGTM (Looks Goot To Me). Please remove the 2 mentioned files from the PR and you can then merge