search

stcorp / harp

Data harmonization toolset for scientific earth observation data
http://stcorp.github.io/harp/doc/html/index.html
BSD 3-Clause "New" or "Revised" License
55 stars 19 forks source link

Add proper quoting support for reading/writing csv files #309

Open svniemeijer opened 3 weeks ago

svniemeijer commented 3 weeks ago

This is affects the .pth dataset files and the collocation result files.

The problem will appear when HARP is going to include support for S5 products which have , characters in the filename. This will then require that the filename is included in the .csv file between double quotes.

See RFC 4180 for a standardised way of dealing with quoting in csv files.

svniemeijer commented 3 weeks ago

The use of , characters seems to be allowed by the WMO file name conventions, so any dataset that follows that convention (such as S4 and S5) might have these characters in their filenames.