jondurbin / airoboros

Customizable implementation of the self-instruct paper.
Apache License 2.0
1.02k stars 71 forks source link

[SUGGESTION] (for v2.1+) Classifier-free guidance #17

Open SabinStargem opened 1 year ago

SabinStargem commented 1 year ago

A technique for making prompt generation stay on target used to only be applicable for images - but now can be used for text. Considering the issue for Airo 2.0, this might help. Apparently, it has been added to the Huggingface transformers library.

Arxiv - Stay on Topic with Classifier-Free Guidance

jondurbin commented 1 year ago

I'll take a look, thanks 👍