search

premAI-io / prem-services

AI Services Maintained by Prem Core Team.
MIT License
6 stars 8 forks source link

Serve Llama 2 70b #63

Closed filopedraz closed 1 year ago

filopedraz commented 1 year ago

Description

Requires multiple GPUs handling