search

replicate / llama-chat

A boilerplate for creating a Llama 3 chat app
https://llama3.replicate.dev
Apache License 2.0
765 stars 289 forks source link

Llava and Salmonn do not properly recognise second file. #67

Open chigozienri opened 8 months ago

chigozienri commented 8 months ago

A second file can be uploaded, but Llava and Salmonn keep referring to the previously uploaded file. I believe this is because they get sent the messageHistory, and this is prioritised over the file.

To replicate:

  1. Upload an image or audio file.
  2. Ask "What's in this [image/audio file]?" and receive description of file 1.
  3. Upload a second image or audio file.
  4. Ask "What's in this [image/audio file]?" and receive description of file 1 again (or even "In the audio file, there is a person speaking about the [contents of image 1]" if you switched between an image and an audio file).

A simple fix would be to (warn the user and) remove all previous message history when a new file is uploaded.

chigozienri commented 8 months ago

@cbh123