bcgov / cthub

Apache License 2.0
2 stars 5 forks source link

CTHUB - GER allow blank/missing values in certain fields #344

Closed katerinkus closed 1 month ago

katerinkus commented 5 months ago

Describe the task The following columns should allow blank values:

Purpose Rows that have missing values in the fields listed above, should still get uploaded.

Acceptance Criteria

Note Some of the blank values are showing up at temp_null in Metabase. I've created card #346 to address this issues as it will pertain to all uploaded data sets.

katerinkus commented 3 months ago

Not able to upload the file for now due to "There was an issue uploading the file" to test this card so I will try again once the issue is fixed.

katerinkus commented 3 months ago

@JulianForeman When I had empty values in Phone Number and Email, I got the following error:

These warnings should only apply to values that are not blank. In this case no warning should have come up for blank cells in Phone Number and Email fields since these fields are allowed to have blank values. I think it may have to do with the order in which the checks are being done. Otherwise, I had no issues!

You can replicate this issue with the test_file_missing_allowed file in GER_SUVI > test_files

katerinkus commented 3 months ago

I created a new ticket to address the issue above. Otherwise, the upload works as expected 👍