search

ScottishCovidResponse / SCRCIssueTracking

Central issue tracking repository for all repos in the consortium
6 stars 0 forks source link

Download error #783

Open bobturneruk opened 3 years ago

bobturneruk commented 3 years ago 
downloader = Downloader(data_directory='.')
downloader.add_data_product(namespace='SCRC', data_product='records/SARS-CoV-2/scotland/cases-and-management/carehomes')
downloader.download()

Response

UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 704: character maps to <undefined>
github-actions[bot] commented 3 years ago

Heads up @mrow84 @bobturneruk - the "data pipeline api" label was applied to this issue.

bobturneruk commented 3 years ago 
from data_pipeline_api.registry.downloader import Downloader
downloader = Downloader(data_directory='.')
downloader.add_data_product(namespace='SCRC', data_product='records/SARS-CoV-2/scotland/cases-and-management/carehomes')
downloader.download()

Runs on Windows 10.

bobturneruk commented 3 years ago

And on Linux.

DennisReddyhoff commented 3 years ago

@nathan-cummings-ukaea Could you try this again and let me know if you're getting the same error?

ghost commented 3 years ago

Hi @DennisReddyhoff the short answer is yes, but don't worry about trying to fix it yet until we catch up.

bobturneruk commented 3 years ago

Ayup. The above code runs (for me) on Windows 10 and Ubuntu 20.04.1 LTS in a clean (git clean -f) repo - no config.yaml is present in the folder. It's possible I'm doing something wildly odd or wrong, or there's something that's being .gitignore'd that's affecting the behaviour.

It creates a metadata.yaml and downloads some stuff into a records/ folder.

bobturneruk commented 3 years ago

Leaving this with @DennisReddyhoff!