elexon-data / insights-issues

This repository serves as a centralised location for tracking and managing issues reported on the Insights Solution.
MIT License
4 stars 0 forks source link

Missing data for ISPSTACK and BOAV prior to 2024-02-01 #40

Open robhawkes opened 6 months ago

robhawkes commented 6 months ago

Describe the issue

Data for ISPSTACK and BOAV (at least) is missing prior to 2024-02-01 while the data does exist in the legacy non-Insights system.

Steps to Reproduce

Steps to reproduce the behavior:

  1. Request ISPSTACK or BOAV data for 2024-01-31
    https://data.elexon.co.uk/bmrs/api/v1/balancing/settlement/stack/all/bid/2024-01-31/1
  2. Notice the response is empty
  3. Try again but for the following day 2024-02-01
    https://data.elexon.co.uk/bmrs/api/v1/balancing/settlement/stack/all/bid/2024-02-01/1
  4. Notice response now contains data

Expected behaviour

Time periods prior to 2024-02-01 should contain data as they do with the legacy system

Screenshots

2024-02-01 as per the Detailed System Prices page

CleanShot 2024-05-09 at 16 36 45@2x

2024-01-31 as per the Detailed System Prices page

CleanShot 2024-05-09 at 16 37 08@2x

2024-01-31 as per the legacy BMReports website

CleanShot 2024-05-09 at 16 39 58@2x

Checks

Please answer the following questions for yourself before submitting an issue.

zghanty commented 5 months ago

@robhawkes : Thank you, we are working to backfill the historical data. We expect the work to be completed by the end of the month.