fix `fairscale` inference example

facebookresearch / esm

Evolutionary Scale Modeling (esm): Pretrained language models for proteins

MIT License

3.16k stars 627 forks source link

fix `fairscale` inference example #298

Closed walid0925 closed 2 years ago

walid0925 commented 2 years ago

Fixes #297

The stochasticity was not due to CPU offloading but instead the loading method, which didn't load the model_data into the model; load_model_and_alphabet_core has the correct behavior.

Tested that the fix generates consistent outputs.