search

USEPA / useeior

Estimating potential environmental impacts of goods and services in the US economy
MIT License
31 stars 19 forks source link

Parquet reading error: #246

Closed WesIngwersen closed 1 year ago

WesIngwersen commented 1 year ago

a WARNING is called on trying to build a model with a recent flowsa 1.3.1 flowbysector parquet "GHG_national_2019_m1_v1.3.1_a5c88ad.parquet"

2023-01-06 11:45:08 INFO::Loading Greenhouse Gases flows from DataCommons... Warning: invalid input found on input connection '..\AppData\Local/flowsa/flowbysector/GHG_national_2019_m1_v1.3.1_a5c88ad.parquet'Warning: incomplete final line found by readTableHeader on '..\AppData\Local/flowsa/flowbysector/GHG_national_2019_m1_v1.3.1_a5c88ad.parquet'Error in value[[jvseq[[jjj]]]] : subscript out of bounds

using most recent arrow package 10.0.1 with R 4.2

WesIngwersen commented 1 year ago

@bl-young any thoughts?

WesIngwersen commented 1 year ago

I will revert to an older arrow package and see if that solves it

WesIngwersen commented 1 year ago

update -- this was just caused by an inconsistency in the model spec file where ScriptFunctionCall was not defined although it was a parquet file specified