search

replicate / cog-llama-template

LLaMA Cog template
Apache License 2.0
307 stars 52 forks source link

Error: Inplace update to inference tensor outside InferenceMode is not allowed #14

Open Pwntus opened 1 year ago

Pwntus commented 1 year ago

A repetition_penalty of 1.1 (or any custom value) will generate the following error:

Inplace update to inference tensor outside InferenceMode is not allowed.You can make a clone to get a normal tensor before doing inplace update.See https://github.com/pytorch/rfcs/pull/17 for more details.