Open robmck-ms opened 4 months ago
Yes I think our image
support is broken right now. You're exactly right that it was written when models and engines were identical :). @nking-1 is looking into how to best re-enable this and also bring support for image
to more models.
Thanks!
In the meantime, I hacked it to work by plumbing Models._variables down through to the _generator function of images (and added OpenAI support too via that hack). Not very elegant, but it unblocks me for now to play with images.
Here it is if you're curious: https://github.com/robmck-ms/guidance/tree/hack_image_support
Any update on this?
The bug Using the multi-modal code from the README results in
TypeError: 'GoogleAIChatEngine' object is not subscriptable
:Looking through the code, image() saves the binary image to Model._variables. GoogleAIChatEngine seems to expect that data to be in self[image_id], but GoogleAIChatEngine nor any of its parent classes has a getitem(). Perhaps it was written in an earlier factoring in which the engine and model objects were one and the same?
To Reproduce
System info (please complete the following information):