Closed nierto closed 6 months ago
Updated this file so it fetches a TIMEOUT variable from the .env file so this project becomes more feasible for CPU inference, current default timeout value in the generate function is not enough for feasible CPU inference.
Thanks for the PR! I will update readme.md soon.
Updated this file so it fetches a TIMEOUT variable from the .env file so this project becomes more feasible for CPU inference, current default timeout value in the generate function is not enough for feasible CPU inference.