Time series basis data for a balance fixing process is available

[MadsBloendAndersen]

Description

As a user i want to prepare time series basis data for a specific process so that I can compare the expected input to the process with the actual output

Acceptance criteria

• [ ] Timeseries basis data are available when a balance fixing process are completed.

• [ ] Each row in the time series report is distinguished by the following attributes:

An example of the report for hourly time series: METERINGPOINTID,TYPEOFMP,STARTDATETIME,ENERGYQUANTITY1,ENERGYQUANTITY2, ENERGYQUANTITY3,ENERGYQUANTITY4,ENERGYQUANTITY5,………………,ENERGYQUANTITY25 570667000000000999,E17,2022-08-31T22:00:00Z,1.0,1.3,4.1,2.1,4.4,……,1.2, 570667000000000999,E17,2022-09-01T22:00:00Z,1.0,1.3,4.1,2.1,4.4,……,1.2,

An example of the report for quarterly time series: METERINGPOINTID,TYPEOFMP,STARTDATETIME,ENERGYQUANTITY1,ENERGYQUANTITY2, ENERGYQUANTITY3,ENERGYQUANTITY4,ENERGYQUANTITY5,………………,ENERGYQUANTITY100 5706670000000007885,E17,2022-08-31T22:00:00Z,1.0,1.3,4.1,2.1,4.4,…………………………,1.2, 5706670000000007885,E17,2022-09-01T22:00:00Z,1.0,1.3,4.1,2.1,4.4,……………………………,1.2,

Note that the exact number of quantity columns depends on daylight savings.

Tasks

• [x] Refactor spark integration tests to fast tests
• [x] Fix todos

[khatozen]

@BjarkeMeier: Vi skal have to filer for basis data, en for timeværdier og en for kvartersværdier. Vi må ikke konverter timeværdier til kvartersværdier og levere kun en fil.

[BjarkeMeier]

@MadsBloendAndersen , @khatozen , do you want to keep the resolution duration columns? They are already implied by the file.

[MadsBloendAndersen]

@BjarkeMeier Not sure what you mean by "resolution duration columns". Do you mean the column header name for each point?

[lasrinnil]

@MadsBloendAndersen @khatozen when you want to test this story, please reach out to me with the "Batch-nummer" of the process you started, ill get you the .csv files for you to inspect.

[MadsBloendAndersen]

@lasrinnil Hi Lasse. I can see in the CSV file , when i convert it to XLSX, then thousands must be separated with a "," See screenshot:

[MadsBloendAndersen]

@khatozen what do you say? the CSV looks like this:

Which actually looks like the CSV file we get from DH2. So I don't know, why excel won't convert separating thousands.

[MadsBloendAndersen]

@lasrinnil I have tested the following issue. Found no issues. looks good.

https://app.zenhub.com/files/345472293/f7dacf90-afe7-4f44-ba5f-793a1112b6a1/download