search

USEPA / emf

Emissions Modeling Framework (EMF)
6 stars 3 forks source link

Can't view QA Step Result -- dataset table name too long? #7

Closed ddelvecchio closed 10 years ago

ddelvecchio commented 10 years ago

Couldn't view QA Step result, even though it seems to have finished (not a refresh issue, I tried to view with no success):

Dataset = Cntld_NEast_NOx_nonpoint_2025_MaxEmsRdxn_70ppb QA Step = compare w/base

Notes:

  1. CSC has renamed dataset, which in turns changed the table name to a different name as shown in the error below.
  2. The original table name (Stored in EMF) is greater than 64 characters, maybe this causes the error thrown below since the table name is too long. Look at code that names table name and make sure it doesn't exceed 64 characters.
  3. Most likely this is table length issue, since renaming dataset changed the table name to smaller than 64 characters and its functioning as expected now.

Some supporting entries from sage's catalina.out:

java.sql.SQLException: No columns found in table 'Cntld_NEast_NOx_nonpoint_2025_MaxEmsRdxn_70ppb_20140509102515436' at gov.epa.emissions.commons.db.TableMetaData.getColumns(TableMetaData.java:46) at gov.epa.emissions.commons.db.TableMetaData.getColumnMap(TableMetaData.java:53) at gov.epa.emissions.framework.services.qa.comparedatasets.SQLCompareDatasetsProgramQuery.getDatasetColumnMap(SQLCompareDatasetsProgramQuery.java:789) at gov.epa.emissions.framework.services.qa.comparedatasets.SQLCompareDatasetsProgramQuery.createProgramQuery(SQLCompareDatasetsProgramQuery.java:336) at gov.epa.emissions.framework.services.qa.comparedatasets.SQLCompareDatasetsProgramQueryRunner.query(SQLCompareDatasetsProgramQueryRunner.java:24) at gov.epa.emissions.framework.services.qa.comparedatasets.SQLCompareDatasetsProgramQueryRunner.run(SQLCompareDatasetsProgramQueryRunner.java:45) at gov.epa.emissions.framework.services.qa.RunQAStepTask.runSteps(RunQAStepTask.java:94) at gov.epa.emissions.framework.services.qa.RunQAStepTask.run(RunQAStepTask.java:74) at gov.epa.emissions.framework.services.qa.RunQAStep.run(RunQAStep.java:35) at gov.epa.emissions.framework.services.GCEnforcerTask.run(GCEnforcerTask.java:23) at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Thread.java:722)

QA Step 'compare w/base' query: Ran QA step, compare w/base, in 0 secs

ddelvecchio commented 10 years ago

Changed function that creates QA table names, to only return the first 63 characters, which is the postgresql table name length

ddelvecchio commented 10 years ago

Also fixed a potential bug with the name of dataset tables being longer than 63 characters