search

hltcoe / sandle

Run a large language modeling SANDbox in your Local Environment
Other
7 stars 1 forks source link

Energon AI OPT server #65

Closed ccmaymay closed 1 year ago

ccmaymay commented 2 years ago

Consider whether the Energon AI OPT server would be a suitable replacement for our backend.

https://github.com/hpcaitech/EnergonAI

ccmaymay commented 1 year ago

Seems to focus on supporting bloom and OPT; seems superseded by newer frameworks