search

PERFORM-Forecasts / documentation

ARPA-E PERFORM Forecasts Documentation
17 stars 8 forks source link

Deterministic Forecast: Zone level issues #4

Closed MajidSKhoshghalb closed 3 years ago

MajidSKhoshghalb commented 3 years ago

Hi

There are two types of issues in deterministic forecasts at the zone level:

1- In Solar: Zone_South_Forecasts.h5 is just zeros 2- In Wind: Zone_East_Forecasts.h5 there is only one line

Thanks in advance!

MRossol commented 3 years ago

@MajidSKhoshghalb

Those file names appear to be old, can you 1) Please confirm you are looking at the most up-to-date files? 2) If so provide us with more information, namely, which forecasts? Day-ahead, intra-day, or intra-hour?

MajidSKhoshghalb commented 3 years ago

@MRossol The files download date is 03/19 so they can't be old.

In Solar_51MemberForecasts folder, Day-ahead and Intra-day both at Zone level: Zone_South_Forecasts.h5 are zeroes and there is no Intra-hour folder here at solar deterministic forecast at all.

In Wind_51MemberForecasts folder, Day-ahead and Intra-day both at Zone level: Zone_East_Forecasts.h5 have only one line and there is no Intra-hour folder here at wind deterministic forecast at all.

MRossol commented 3 years ago

@MajidSKhoshghalb

Can you please provide the full S3 paths your talking about because I don't follow. There is no Solar_51MemberForecasts or Wind_51MemberForecasts folder...

Here are the files I'm familiar with for Day-ahead zone-level forecasts: Wind: ╰─ aws s3 ls s3://arpa-e-perform/ERCOT/2018/Wind/Forecasts/Day-ahead/Zone_level/ 2021-03-19 13:57:52 6062893 Zone_Coast_wind_day-ahead_fcst_2018.h5 2021-03-19 13:57:52 5854089 Zone_East_wind_day-ahead_fcst_2018.h5 2021-03-19 13:57:52 6540918 Zone_Far_West_wind_day-ahead_fcst_2018.h5 2021-03-19 13:57:53 6491757 Zone_North_Central_wind_day-ahead_fcst_2018.h5 2021-03-19 13:57:53 6547913 Zone_North_wind_day-ahead_fcst_2018.h5 2021-03-19 13:57:53 6135536 Zone_South_Central_wind_day-ahead_fcst_2018.h5 2021-03-19 13:57:53 6523644 Zone_Southern_wind_day-ahead_fcst_2018.h5 2021-03-19 13:57:53 6514394 Zone_West_wind_day-ahead_fcst_2018.h5

Solar: ╰─ aws s3 ls s3://arpa-e-perform/ERCOT/2018/Solar/Forecasts/Day-ahead/Zone_level/ 2021-03-19 13:52:39 3343184 Zone_Coast_solar_day-ahead_fcst_2018.h5 2021-03-19 13:52:39 3333777 Zone_East_solar_day-ahead_fcst_2018.h5 2021-03-19 13:52:39 3372092 Zone_Far_West_solar_day-ahead_fcst_2018.h5 2021-03-19 13:52:39 3354911 Zone_North_Central_solar_day-ahead_fcst_2018.h5 2021-03-19 13:52:39 3404194 Zone_North_solar_day-ahead_fcst_2018.h5 2021-03-19 13:52:40 3342068 Zone_South_Central_solar_day-ahead_fcst_2018.h5 2021-03-19 13:52:40 3357230 Zone_Southern_solar_day-ahead_fcst_2018.h5 2021-03-19 13:52:40 3329463 Zone_West_solar_day-ahead_fcst_2018.h5

As you can see Zone_South_Forecasts.h5 and Zone_East_Forecasts.h5 do not exist...

MajidSKhoshghalb commented 3 years ago

@MRossol Deterministic forecasts are in ECMWF folder.

1- s3://arpa-e-perform/ERCOT/2018/ECMWF/Solar_51MemberForecasts/Day_ahead/Zone_level/Zone_South_Forecasts.h5 just zero

2- s3://arpa-e-perform/ERCOT/2018/ECMWF/Solar_51MemberForecasts/Intra_day/Zone_level/Zone_South_Forecasts.h5 just zero

3- s3://arpa-e-perform/ERCOT/2018/ECMWF/Wind_51MemberForecasts/Day_ahead/Zone_level/Zone_East_Forecasts.h5 only one line

4- s3://arpa-e-perform/ERCOT/2018/ECMWF/Wind_51MemberForecasts/Intra_day/Zone_level/Zone_East_Forecasts.h5 only one line

MRossol commented 3 years ago

@MajidSKhoshghalb, thanks for clarifying, @fengcong1992 Can you investigate?

MRossol commented 3 years ago

@MajidSKhoshghalb files fixed and re-uploaded.

MajidSKhoshghalb commented 3 years ago

@MRossol and @fengcong1992 Thanks.