search

NREL / buildstockbatch

Other
21 stars 14 forks source link

The data in the buildstock csv in Athena is not correct #428

Open yingli-NREL opened 8 months ago

yingli-NREL commented 8 months ago

Describe the bug In Athena, the data in the buildstock csv file is not correct, see the following figure. image There is a comma in some value of the output. In Athena, those kind of data is in two columns.

Work around The buildstock csv in the S3 is correct. Can use that one. Need make improvement for buildstockbath to figure out this problem.

Platform:

afontani commented 7 months ago

From @nmerket : Upload the buildstock.parquet instead of the buildstock.csv. @rajeee second, but could also look at the crawler configuration to see if there is an easy way to fix this issue. The discussion seems to be leaning towards 1) upload both .csv and .parquet but only crawl the .parquet or 2) fix the crawler?