NER -- support `transformers`

nicolay-r / ARElight

Granular Viewer of Sentiments Between Entities in Massively Large Documents and Collections of Texts, powered by AREkit

MIT License

37 stars 2 forks source link

Closed nicolay-r closed 1 year ago

nicolay-r commented 1 year ago

[x] Implement Unit-test
[x] Embed the related unit-test into system.
[x] :bar_chart: Book processing Benchmark for improvement assessment
- 121
  
  Results are pretty much similar due to the batch-size = 1 with DeepPavlov
- There is a limitation in AREKit==0.24.0: text processing is performed per sentences, i.e. batch size = 1. (https://github.com/nicolay-r/AREkit/issues/535)

nicolay-r commented 1 year ago

Batch-size support won't be fixed atm due to the relatively long-term API refactoring in AREkit