search

sxflynn / TeacherGPT

A proposed GPT chatbot for teachers that uses retrieval-augmentation to answer questions about their students.
MIT License
8 stars 1 forks source link

Use spaCy for Named Entity Recognition to increase speed and reduce cost #8

Open sxflynn opened 5 months ago

sxflynn commented 5 months ago

Currently named entity recognize it performed using an LLM, which is slower and more expensive than a local model might be such as spaCy.

An enhancement would be to use spaCy for a first round of name searching and data retrieving, and using the LLM on the second pass if no name is found.