snuspl / parallax

A Tool for Automatic Parallelization of Deep Learning Training in Distributed Multi-GPU Environments.
Apache License 2.0
130 stars 35 forks source link

Automatic variable partitioning #24

Closed sj6077 closed 5 years ago

sj6077 commented 5 years ago

Things to Change

Enable automatic variable partitioning for large variables

Current Behavior

Variable partitioning is manually done

Expected Behavior

Parallax finds a near-optimal number of partitions automatically

Failure Information (for bugs)

Failure Logs

How to Reproduce

Related Issues