ma7dev / OnlySudo

A Discord/Twitch bot that uses AI models to do some cool stuff.
16 stars 1 forks source link

AI #6

Open ma7dev opened 2 years ago

ma7dev commented 2 years ago
ma7dev commented 2 years ago

TorchServe seems to be a way to handle serving multiple models and having an access point to them. I thought it had a way to quantize the model like TensorFlowLite in order to reduce the model size and increase the speed of computation.