Closed fpena06 closed 1 year ago
What happens if "--top_k" argument is non-zero or deleted? If top_k is 0, I think the gpt_sample_top_k_top_p function in common.cpp is accessing out of range of logits_id.
What happens if "--top_k" argument is non-zero or deleted? If top_k is 0, I think the gpt_sample_top_k_top_p function in common.cpp is accessing out of range of logits_id.
Thank you. That worked.
I'm getting the following output when trying to run: