jpwahle / cs-insights-backend

API server of the cs-insights project. This is the main part of storing data and accessing an external data analysis endpoint. It uses a mongoDB instance to store everything and queries the cs-insights-prediction-endpoint to get machine learning results.
https://jpwahle.github.io/cs-insights-backend/
MIT License
7 stars 0 forks source link

Precompute standard cases for LDA topic models #65

Closed trannel closed 1 year ago

trannel commented 2 years ago

Is your feature request related to a problem? Please describe. Computing the topic model visualization for large sets of data takes a lot of time and resources. There already is an environment variable to limit the maximum amount of papers a query is allowed to result in. For the two default cases: "no filters" and "default filters", it would make sense to use precomputed values.

Describe the solution you'd like Add special cases for "no filters" and "default filters", where the backend will not compute anything. The backend will instead directly query the predictions endpoint, which should also precompute the data for those two cases.