catalyst-cooperative / mozilla-sec-eia

Exploratory development for SEC to EIA linkage

MIT License

0 stars 0 forks source link

Second pass Ex. 21 model improvements #86

Closed katie-lamb closed 1 day ago

katie-lamb commented 1 month ago

Overview

Closes #78 .

What problem does this address?

Removed paragraph layout docs from validation data
Handled subsidiaries that spanned multiple rows and were grouped into one entity
Removes duplicate rows from extracted tables

Testing

How did you make sure this worked? How can a reviewer verify this?

To-do list

- [x] Review the PR yourself and call out any questions or issues you have
- [x] Try to use Corpwatch dataset as validation - moved to separate issue
- [x] Maybe: Create threshold for failures based on logits - moved to separate issue
- [x] Create plan for paragraph layout document classifier

review-notebook-app[bot] commented 1 month ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB