SolarArbiter / solarforecastarbiter-core

Core data gathering, validation, processing, and reporting package for the Solar Forecast Arbiter
https://solarforecastarbiter-core.readthedocs.io
MIT License
33 stars 21 forks source link

add pnnl data parser #669

Closed wholmgren closed 3 years ago

wholmgren commented 3 years ago
wholmgren commented 3 years ago

Works but 1 year of data exceeds the API limit.

2021-04-16 14:13:49,472 INFO Updating PNNL ghi from 2017-01-01 00:00:00+00:00 to 2018-01-01 00:00:00+00:00.
2021-04-16 14:13:49,611 DEBUG Posting data to PNNL ghi between 2016-12-31 16:00:00-08:00 and 2017-12-31 15:59:00-08:00.
2021-04-16 14:13:53,701 DEBUG Resetting dropped connection: dev-api.solarforecastarbiter.org
2021-04-16 14:13:56,087 DEBUG https://dev-api.solarforecastarbiter.org:443 "POST /observations/8abae936-9ef7-11eb-881b-0a580a8003fa/values HTTP/1.1" 413 80
2021-04-16 14:13:56,087 ERROR Posting data to PNNL ghi failed.
2021-04-16 14:13:56,087 DEBUG HTTP Error: {"errors":{"413":"Payload Too Large. Maximum payload size is 16777216 bytes."}}
wholmgren commented 3 years ago

3 months works

solararbiter referencedata update --network 'PNNL' --base-url 'https://dev-api.solarforecastarbiter.org' --start 20170101 --end 2017040