kwargs missed during generation

andyzoujm / representation-engineering

Representation Engineering: A Top-Down Approach to AI Transparency

https://www.ai-transparency.org/

MIT License

716 stars 86 forks source link

Open HenryCai11 opened 2 months ago

HenryCai11 commented 2 months ago

The repe_kwargs passed to generate will get lost. I assume it's due to things happen in the HuggingFace generate method.

System info: I'm using the latest transformers