Open astachowiczhabana opened 4 days ago
Hi @libinta this commit is also required with next OH release
@astachowiczhabana which model and configuration are you running with this flag enabled? We'd like to do the same for the OH CI/PYTEST.
@astachowiczhabana dont we need to update README for all the models with this option ?
@jiminha
Inference - 1 card:
Training - 8 cards:
The new option --sdp_on_bf16 allows pyTorch to use reduced precision in sdp in the math backend. The change affects the following examples: