karenjexphd / classification_extraction_tests

Docker images and runtime commands for end-to-end cell classification and table extraction tests
0 stars 0 forks source link

New DDL scripts need to be included in the main classification extraction script #5

Closed karenjexphd closed 1 year ago

karenjexphd commented 1 year ago

New scripts have been generated to create required views and indexes. The main script needs to be updated to call these during table model schema creation

karenjexphd commented 1 year ago

added 02b_create_indexes.sql to CompareExtractionMethods.sh not sure if 04a_create_canonical_table_views.sql is needed

karenjexphd commented 1 year ago

tabby_cell_view from 04a_create_canonical_table_views.sql is needed whilst mapping GT or output to the table model. The following errors were encountered:

File "/home/karen/workspaces/classification_extraction_tests/MapToTableModel/map_tabbyxl.py", line 268, in cur.execute(insert_stmt) psycopg2.errors.UndefinedTable: relation "tabby_cell_view" does not exist LINE 1: ... FROM label_temp lt JOIN tabby_cell... ^ File "/home/karen/workspaces/classification_extraction_tests/./MapToTableModel/map_tabbyxl.py", line 268, in cur.execute(insert_stmt) psycopg2.errors.UndefinedTable: relation "tabby_cell_view" does not exist LINE 1: ... FROM label_temp lt JOIN tabby_cell... ^ File "/home/karen/workspaces/classification_extraction_tests/./MapToTableModel/map_hypoparsr.py", line 210, in cur.execute(insert_stmt_el) psycopg2.errors.UndefinedTable: relation "tabby_cell_view" does not exist LINE 1: ... FROM entry_label_temp elt JOIN tabby_cell... ^

CREATE VIEW statements removed from 04a_create_canonical_table_views.sql and added to 04_create_views.sql for: tabby_cell_view tabby_entry_view tabby_label_view tabby_entry_label_view

karenjexphd commented 1 year ago

Fixed in commit https://github.com/karenjexphd/classification_extraction_tests/commit/e7cb1c88f74d16740ef4df3f70b3cbb99195f495