Open fubai-666 opened 2 months ago
File "/workspace/nkh1szh/TOD3Cap/llama/utils.py", line 16, in sample_top_p next_token = torch.multinomial(probs_sort, num_samples=1) RuntimeError: probability tensor contains either inf, nan or element < 0
inf
nan
File "/workspace/nkh1szh/TOD3Cap/llama/utils.py", line 16, in sample_top_p next_token = torch.multinomial(probs_sort, num_samples=1) RuntimeError: probability tensor contains either
inf
,nan
or element < 0