search

wenwenyu / PICK-pytorch

Code for the paper "PICK: Processing Key Information Extraction from Documents using Improved Graph Learning-Convolutional Networks" (ICPR 2020)
https://arxiv.org/abs/2004.07464
MIT License
556 stars 193 forks source link

During training, entities are disappearing in the training metrics #9

Closed sophiajwchoi closed 4 years ago

sophiajwchoi commented 4 years ago

Hi, I have the following entities I want to extract. During the training, some entities are not shown in the table and keep disappearing. When I restart the training process, the number of entities shown in the metric table is also different. It gives me an inconsistent result. Do you know what I can do to fix it?

Entities_list = [ "invoice_date", "tax_rate", "subtotal", "total" ] For example,

+--------------+-------+-------+-------+-------+ | name | mEP | mER | mEF | mEA | +==============+=======+=======+=======+=======+ | total | 0 | 0 | 0 | 0 | +--------------+-------+-------+-------+-------+ | invoice_date | 0 | 0 | 0 | 0 | +--------------+-------+-------+-------+-------+ | overall | 0 | 0 | 0 | 0 | +--------------+-------+-------+-------+-------+

+--------------+-------+-------+-------+-------+ | name | mEP | mER | mEF | mEA | +==============+=======+=======+=======+=======+ | invoice_date | 0 | 0 | 0 | 0 | +--------------+-------+-------+-------+-------+ | overall | 0 | 0 | 0 | 0 |

wenwenyu commented 4 years ago

@sophiajwchoi One possible reason is that your train batch data don't contain the entity label provided in Entities_list. Make sure the input data has the corresponding entity value. Hope it can help you.