search

OHDSI / DeepPatientLevelPrediction

An R package for performing patient level prediction using deep learning in an observational database in the OMOP Common Data Model.
https://ohdsi.github.io/DeepPatientLevelPrediction
11 stars 4 forks source link

Add multi-gpu support #41

Open egillax opened 2 years ago

egillax commented 2 years ago

It would be good to be able to use multiple-GPUs to train your model. Especially for bigger model such as Transformers and models using temporal data. This is something me and @ted9219 briefly talked about during the OHDSI symposium.

lhjohn commented 1 year ago

Various method could speed up model training by spreading training workload across multiple worker nodes.

Data parallelism

Feature not yet available: mlverse/torch has an open issue for implementing DataParallel.

Model parallelism