openlangrid / mlgrid-services

A framework to serve various generative AIs and other machine learning functions via WebSocket and JSONRPC.
Apache License 2.0
2 stars 0 forks source link

GPUを使用するプロセスで使用メモリ量を計測し返すようにする #24

Closed takawitter closed 9 months ago

takawitter commented 9 months ago
takawitter commented 9 months ago

Java側は対応。あとはPython側で個別対応。microsoft/phi-2とElyzaJapaneseLlama2では対応済み。