ImagingDataCommons / ETL

(CORE REPO)
Apache License 2.0
0 stars 1 forks source link

acrin_6698 sbrgrade NAs are replaced with nulls #42

Open fedorov opened 2 years ago

fedorov commented 2 years ago

Occurrences of NA in the input data should be parsed into NA string. Currently, at least for the acrin_6698 collection, they become nulls for the sbrgrade, which is wrong and confusing, given that the dictionary parsed lists "NA" as a named value for that column.

image image
G-White-ISB commented 2 years ago

Still investigating. It should be resolved by v12.

G-White-ISB commented 2 years ago

The pandas module for importing the CSV/Excell files was changing 'NA' to null. This has been fixed