search

llSourcell / Doctor-Dignity

Doctor Dignity is an LLM that can pass the US Medical Licensing Exam. It works offline, it's cross-platform, & your health data stays private.
Apache License 2.0
3.84k stars 403 forks source link

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0 #18

Open chunhualiao opened 1 year ago

chunhualiao commented 1 year ago

After 2.4 Run Fine-Tuning Loop, I got the following error when running 2.6 Evaluate Performance (USMLE):

Traceback (most recent call last): File "llama2.py", line 450, in accuracy = evaluate_model(model, tokenizer, dataset,"") File "llama2.py", line 284, in evaluate_model output = model.generate(input_ids, num_beams=4)
File ". pytorch/1.13.1/lib/python3.9/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context return func(*args, *kwargs) File ".local/unknown/pytorch1.13.1/lib/python3.9/site-packages/transformers/generation/utils.py", line 1665, in generate return self.beam_sample( File ".local/unknown/pytorch1.13.1/lib/python3.9/site-packages/transformers/generation/utils.py", line 3309, in beam_sample next_tokens = torch.multinomial(probs, num_samples=2 num_beams) RuntimeError: probability tensor contains either inf, nan or element < 0