effectiveaccelerationism / text-to-banger

A simple API converting a user's proposed tweet into a veritable banger.
GNU General Public License v3.0
98 stars 13 forks source link

Add finetuning data #24

Closed codethazine closed 1 year ago

codethazine commented 1 year ago
codethazine commented 1 year ago

Finetuned with the data on OAI Curie and ran some tests. Better than the OAI prompted server, but deff still needs some fiddling with:

image image image

Extra tests:

  1. Add extra data, currently fine-tuned on ~500 tweets, e.g. getting it to ~1000
  2. Change data augmentation logic, e.g. extract what tweet is about and use that as training prompt
  3. Change base model, e.g. curie -> davinci, or llama2