txau
commented
2 months ago I think we need clarification on what the different numbers in stats panel mean:
-
LABELED: it means the conditions for being labeled are met. But these conditions depend on the type of information you are extracting:
- text, number, date: it has a value and a text selection
- selects/relationships: it has a value, no need for text selection
- all of them: something marking the "empty value" as the labeled data
-
Accuracy: calculation based on matches/mismatches for labeled data
-
Match: there is labeled data, there is a suggestion and they match
-
Mismatch: there is labeled data, there is a suggestion and they do not match
-
NON-LABELED: they do not meet the criteria for labeled
- Pending: I don't know what this represents at this moment. We should take a look to the code
- No suggestion: not sure about this one too. I guess it means, it is not obsolete, error or no context. The model returned something but it is empty? Should we rather say that the suggestion is "empty"?
- No context: the model could not figure out a text? the context returned by the model is empty?
- Obsolete: the model is training and extracting suggestions. This is a transitional state that only should happen WHILE training. So this should be always CERO after training
- Others: I do not know if there is any other possible state apart from error. Probably we could change this to just "error". Make sure that errors and obsoletes are not the same (an error should still update the suggestion to the latest model, so it is no longer obsolete). Check the code to see if there is any other possible meaning for error.
We are also still waiting for a new category in non-labeled that is "Suggestion".
After reviewing these descriptions, we should update the side panel to reflect this, then the status could be shown in the table as well.
aphilop
At the moment we display only a few statuses (eg. 54 values | 54 suggestions | 54 mismatching). We need to add more statuses that are also displayed in the Stats & Filters panel