uezo / ChatdollKit

ChatdollKit enables you to make your 3D model into a chatbot

Apache License 2.0

684 stars 73 forks source link

Support message with image in GPT-4V and Claude3 #286

Closed uezo closed 4 months ago

uezo commented 4 months ago

🖼️ How to send image in demo

Configure and run demo. Use GPT-4V(gpt-4-vision-preview) or Claude3(claude-3-sonnet-20240229, claude-3-opus-20240229).
Click image icon on input field.
Input path to image file and press enter key then image is set.
Wake and say something or input something to message input.

Developer info

GPT-4V: Set image as byte[] to payload of request with key "imageBytes" or set image url with key "imageUrl".
Claude3: Set image as byte[] to payload of request with key "imageBytes".