search

ioos / ioos-asset-inventory

Building the IOOS asset inventory with python
0 stars 0 forks source link

remove carriage return at end of Raw_Vars field #20

Closed MathewBiddle closed 2 years ago

MathewBiddle commented 2 years ago

Tried to load the 2020 processed inventory into ERDDAP and received some errors:

Found/using sampleFileName=/datasets/2020/processed_inventory.csv
WARNING: Bad line(s) of data in readASCII(/datasets/2020/processed_inventory.csv):
WARNING: skipping line #98: unexpected number of items (observed=34, expected=35). [a]
WARNING: skipping line #99: unexpected number of items (observed=1, expected=35). [a]
WARNING: skipping line #100: unexpected number of items (observed=34, expected=35). [a]
WARNING: skipping line #101: unexpected number of items (observed=1, expected=35). [a]
WARNING: skipping line #102: unexpected number of items (observed=34, expected=35). [a]
WARNING: skipping line #103: unexpected number of items (observed=1, expected=35). [a]
...

Looks like some carriage returns snuck in the Raw_Vars field. Need to update python script to remove carriage returns.

Example, https://github.com/ioos/ioos-asset-inventory/blob/main/2020/processed_inventory.csv#L99