SIS-Team-24 / 2023-SIS-Team-24

Using Natural Language Processing, Text Insights examines and provides insights to text.
1 stars 0 forks source link

Fix performance issues #189

Closed henrygoodman closed 11 months ago

henrygoodman commented 11 months ago

Fixes #188

If summary tokens is > 5000 then use the sm model, otherwise use the trf model.

This should be fine since if tokens > 1024 we only perform extractive until the input is small enough to analyse abstractively.