etherlabsio / ai-engine

Core AI services and functions powering the ETHER Platform
MIT License
0 stars 0 forks source link

Improve the quality of chapter keyphrases #111

Closed shashankpr closed 5 years ago

shashankpr commented 5 years ago

Issue observed

Currently, in chapters, the number of Entities overpowers or clutters the chapter keyphrases. The current logic displays all entities and if the number is greater than 6 then only 3 descriptive keyphrases are displayed.

  1. The quality of entities is questionable
  2. The number of keyphrases is lesser than entities in some cases creating confusion.
  3. The quality of keyphrases itself is not consistent.

Possible solution

  1. Compare the production chapters with ranking-based chapters if the quality improves.
  2. Check for the subject or phrases that encompass the discussion.
  3. Have a preference logic set for Entities: Something like - PRODUCT > ORG > PERSON > LOC and the frequency of their occurrence to filter them out
shashankpr commented 5 years ago

Currently deployed in staging2. Waiting for feedback to deploy it to production

shashankpr commented 5 years ago

deployed and tested on production