timothybrooks / instruct-pix2pix

Other
6.28k stars 530 forks source link

accessing the prompt? #98

Open dcsan opened 1 year ago

dcsan commented 1 year ago

is there any way to access a prompt that is generated from the user's edits? ie when using the model via API on replicate

I see the generate button in prompt_app.py

calls the generate command in dataset_creation https://github.com/timothybrooks/instruct-pix2pix/blob/main/dataset_creation/generate_txt_dataset.py

So I assume this is for offline training of datasets?

Also there is what looks like normal SD scripts for passing prompts into the SD model https://github.com/timothybrooks/instruct-pix2pix/blob/main/stable_diffusion/scripts/txt2img.py#LL295C60-L295C60

But i'm not sure where the runtime API for replicate is in this codebase? Or is it separate from this repo?

My question is if the prompt exists somewhere as modified plain text, or if the communication with the stability model is all with more blackbox with word vectors getting modified and passed around so there is never an updated prompt?