search

runtimerevolution / labs

0 stars 0 forks source link

NLP Interface: Investigate acceptable minimum characters for NLP #39

Closed sIldefonsoRR closed 3 months ago

sIldefonsoRR commented 3 months ago

The idea is to test, investigate and determine the number of minimum characters of a request string that should pass through an NLP worker in order to generate a summary text to be used in an LLM prompt.

To do so, here are the possible tasks:

Test the existing Spacy configuration with various prompts having different text lengths.

  • Record the results

Test the different Spacy configurations with various prompts having different text lengths.

  • Record the results

Investigate NLP technologies, different than Spacy.

  • Record the results

At the end, define the optimal, configuration for NLP:

  • Library
  • Minimum length for NLP summary
lmoreira-runtime commented 3 months ago

New wiki page with the results:

https://github.com/runtimerevolution/labs/wiki/NLP-Performance-Tests

sIldefonsoRR commented 3 months ago

Issue closed