search

microsoft / onnxruntime-training-examples

Examples for using ONNX Runtime for model training.
MIT License
310 stars 62 forks source link

Which command can be used to run the Bert model from scratch? #115

Closed Soroushmehr1 closed 1 year ago

baijumeswani commented 1 year ago

Would you please share your use case?

If you're trying to run with ORTModule, you can find instructions on running bert here

prathikr commented 1 year ago

@Soroushmehr1 please update this thread by EOW or the issue will be marked as stale and closed.

Soroushmehr1 commented 1 year ago

I used the same code as suggested above but this seems to be just for fine-tuning.

prathikr commented 1 year ago

@Soroushmehr1 Is your issue resolved? If not, can you please add more details to the description of this issue?

Soroushmehr1 commented 1 year ago

No. The following command suggested above is for fine tuning. My question: Which command can be used to train the model from scratch (i.e. complete training)? Or which changes should be made to the code so it can train the model from scratch?

python hf-ort.py --hf_model bert-large --run_config ort --process_count --local_run