search

lukalabs / cakechat

CakeChat: Emotional Generative Dialog System
Apache License 2.0
1.7k stars 935 forks source link

Recommended server specs? #71

Closed sheldonrampton closed 5 years ago

sheldonrampton commented 5 years ago

I've got cakechat running now on a Debian box that I set up on Google Cloud Platform and am using it on a test app receives messages and sends back response to a Facebook messenger app. It's nice!

I'm wondering if you have any suggestions regarding server requirements: recommended RAM, disk size, number of CPUs, etc.?

nicolas-ivanov commented 5 years ago

@sheldonrampton that depends on your demands, actually. What RPS are you expecting to have?

To max out the performance you should consider renting a GPU with CUDA support: https://developer.nvidia.com/cuda-gpus

The performance varies a lot for different generation modes. Here are the results we've got on Nvidia GeForce RTX 2080 when running the server with 4 workers on 1 GPU using gunicorn:

stale[bot] commented 5 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.