search

vgaggia / JoyCaption-Extended-Un-Official

An un-official extended version of the original joycaption pre-alpha repo
6 stars 0 forks source link

Possible to modify prompt? #1

Closed evanheckert closed 1 month ago

evanheckert commented 2 months ago

This is fantastic, thanks for putting this together!

I'm curious if you've played with the prompt and the language model used to significantly steer the attention or format of the captioning?

I've been using MNeMoNiCuZ/joy-caption-batch before finding this repo, and when I use mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated then changing the PROMPT value seems to nudge the wording very slightly, but it still mentions all the same properties.

vgaggia commented 2 months ago

I couldn't get the vlm prompt to effect the result, just like in that other repo, I'm not sure why to be honest.