Follow up Message Fails

[JosephValle]

When using the model: 2b-it-int8, you can't seem to get a second response, just crashes the app.

Xcode shows this error:

Thread 1: signal SIGABRT An abort signal terminated the process. Such crashes often happen because of an uncaught exception or unrecoverable error or calling the abort() function.

Tried with the example app with an asset load of it

And my own app with a network load. First message gets sent second throws that error in xcode

In Xcode:

func generateResponse(prompt: String) throws -> String {
        try session?.addQueryChunk(inputText: prompt)
        return try session?.generateResponse() ?? "" <-- seems to be called on that line
    }

my flutter code, it is only the 4th message. I send one to set the tone/usage prompt, one that's the user prompt, get a response, and then another user prompt and it breaks

Message example

• user: you are to act as an advice giver
• user: I went on a walk and it was nice -sent
• response: something about how to keep at it -receieved
• user: i went on another walk - sent

• crash

  final response = await _flutterGemmaPlugin.getChatResponse(messages: _messages.whereType(), chatContextLength: _messages.whereType().length);

  Again thank you for all you do, let me know if I can do anything to help!

[DenisovAV]

Thank you! Looks like I didn't check ios properly when updated to 0.4.0, will fix it soon

[DenisovAV]

Please try with 0.4.2