Closed andylizf closed 6 days ago
Implement with_data API
with_data
with_data(path, size_gb=...)
(preprocess >> train_a).with_data('/data/model_a', size_gb=2.0) (preprocess >> train_b).with_data('/data/model_b', size_gb=2.0)
Update YAML Configuration
Add Documentation and Examples
Implement
with_data
APIwith_data(path, size_gb=...)
method on task edges to specify unique data paths for each downstream task.Update YAML Configuration
Add Documentation and Examples
with_data
in both code and YAML, with example configurations.