search

ETS-Next-Gen / writing_observer

Writing Observer and Learning Observer: A system for monitoring learning process data, with an initial focus on writing process data from Google Docs.
https://learning-observer.readthedocs.io/en/latest/
GNU Affero General Public License v3.0
11 stars 9 forks source link

NLP Caching #49

Open bradley-erickson opened 1 year ago

bradley-erickson commented 1 year ago

We want to cache results from the NLP so data is not run multiple times on the same text. Additionally this should improve performance in cases where multiple dashboards for the same text are open.

We may want to run the full set of indicators on the student text every so often to always try and provide information immediately to teachers, even if the indicators are a little bit out of data.

This could include indexing by text or by document id.

The cache should include which indicators were run, the results from the indicators, and additional meta data about the cache (like process id).

bradley-erickson commented 11 months ago

An initial version of this has been completed in Arglab PR:80.

As we start to have more dashbaords, we should consider how best to abstract some of the caching logic.