Model pre-loaded into memory?

[ndvbd]

Just so it will be clear - does this solution keeps the memory/neural net in memory, or is it stateless and does the model loading each time?

[Tpt]

Yes, it does.