apartresearch / deepdecipher

🦠 DeepDecipher: An open source API to MLP neurons
https://apartresearch.com
MIT License
9 stars 0 forks source link

Investigate other async runtimes for Python functions #98

Open albertsgarde opened 1 year ago

albertsgarde commented 1 year ago

Most of the Python API currently starts a Tokio runtime for each function call. This can be expensive, so maybe a more lightweight runtime like smol would be fitting.

Note that this is incredibly low priority since it only touches the parts of the API relevant for creating the database which is not performance critical at all, and most of these functions take a long time anyway.