reduced number of gpu layers to not cause integer overflow

edgenai / edgen

⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.

https://docs.edgen.co/

Apache License 2.0

333 stars 15 forks source link

reduced number of gpu layers to not cause integer overflow #75

Closed pedro-devv closed 8 months ago