search

US-EPA-CAMD / easey-ui

Project Management repo for EPA Clean Air Markets Division (CAMD) Business Suite of applications
MIT License
0 stars 0 forks source link

Bug: Some bulk files have columns with comma-delimited values and others pipes within the same data year #6294

Open j-tafoya opened 4 weeks ago

j-tafoya commented 4 weeks ago

Original ticket was #4888

Steps to Reproduce

Step 1

Action: Download 2021 Daily Emissions for 2021 q1-q4 Expected Result: All the data in PM Controls should be pipe-separated

Actual Results

Some units have PM Controls comma-separated in one quarter and pipe-separated in the next

Example: ORIS 26, Unit ID 2 has "Baghouse|Electrostatic Precipitator" in Q1 and "Baghouse,Electrostatic Precipitator" in Q2

Requirements

All columns should be consistent for all bulk files. The solution may just be to re-run the quartz jobs that generate the bulk files.

annalbrecht commented 1 week ago

@szintgraff @j-tafoya

Since 6/1/2023, emissions resubmissions have occurred for 2018 Q1 forward.

Commas are still present in the following files:

Questions for EPA:

  1. Should all fields be pipe delimited, e.g., fuel type, program, etc.
  2. What files need to be regenerated-- what years, which types?
szintgraff commented 10 hours ago

@annalbrecht @alangmaid

After meeting with EPA CAMPD team. Lets move this to on hold and prioritize it with the other CAMPD tickets in on hold when the time comes.