Open ZeyiLiao opened 1 year ago
from transformers import AutoModelForSeq2SeqLM, AutoTokenizer,AutoModelForCausalLM from parallelformers import parallelize model = AutoModelForCausalLM.from_pretrained('EleutherAI/gpt-neo-2.7B') parallelize(model, num_gpus=4, fp16 = False)
How to reproduce
Environment