HabanaAI / Model-References

Reference models for Intel(R) Gaudi(R) AI Accelerator
153 stars 79 forks source link

Blocked with missing Bert FT steps #41

Open gbertulf opened 4 months ago

gbertulf commented 4 months ago

To whom this may concern,

Regarding the steps mentioned under 'Packing the Data"

image

Some queries

1) Where would input_dir for dataset_path_phase1 or _phase 2 come from? 2) Tried to run the pretraining script with -h option and got this error, could not find the optimize.py source for scipy module

image

Lastly,could not download the Data_packing_technique file from the link shared, is there an alternate link?