Preload Model for Faster Predictions

aksnzhy / xlearn

High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.

https://xlearn-doc.readthedocs.io/en/latest/index.html

Apache License 2.0

3.09k stars 519 forks source link

Preload Model for Faster Predictions #350

Open jwnz opened 4 years ago

jwnz commented 4 years ago

Loading the model for predictions takes a long time.

This is problematic when handling data in small batches as the model has to be loaded for every batch.

Is there a way of preloading the model for faster inference of small batches when using the Python API?

This may be a duplicate of #298