allenai / unified-io-2.pytorch

Apache License 2.0
52 stars 1 forks source link

Training/Fine-tuning with unified-io-2 #5

Open Alpkant opened 3 weeks ago

Alpkant commented 3 weeks ago

Is there anything related to how you do the training or fine-tuning? I am unaware of how to do the preprocessing step in parallel so that batch-wise preprocessing and fine-tuning would be efficient. If you have some small examples, it would be great how to do fine-tuning.