search

plow-technologies / inferno

A statically-typed functional scripting language
MIT License
4 stars 1 forks source link

Add `inferno-ml-remote` #59

Closed ngua closed 1 year ago

ngua commented 1 year ago

Note: Supersedes #58. Somehow the commit history got all messed up, so I just squashed the changes onto a new branch

Adds a server that evaluates Inferno scripts with ML features (i.e. Hasktorch integration), with support for loading models and configuration for a model store and cache. At the moment, it only supports a single model store (so no support for user model stores)

This is used in inferno-ml-deploy

Note that this is largely a proof-of-concept at this point. An actual production system might be quite different

siddharth-krishna commented 1 year ago

Btw, I can't seem to find https://github.com/plow-technologies/inferno-ml-deploy