search

nerve-sparks / iris_android

Local LLM App
https://nervesparks.com/
Apache License 2.0
119 stars 8 forks source link

Interface, Optimization #26

Open theglitcharchitect opened 5 months ago

theglitcharchitect commented 5 months ago

I've been using this app for nearly three days on my S23 Ultra 12/512. It runs smoothly unless I have other apps open in the background. Initially, the phone doesn't heat up much, and for the first 10-15 questions, it works perfectly. However, after about half an hour, the AI starts to glitch out, continuously answering the same question. Perhaps it's due to optimization issues on the handset. Finally, the interface could use an update. Still, overall, it's an awesome app, guys!

AryanshuCreates commented 4 months ago

working on it, fix coming soon.

Kid-Kisuke commented 4 months ago

@theglitcharchitect #30 fixes some of these issues, merged in master. New release coming soon.

Kid-Kisuke commented 4 months ago

@theglitcharchitect have you tried the new build?

theglitcharchitect commented 4 months ago

@theglitcharchitect have you tried the new build?

I've been using Version 0.2 since its release and have encountered significant issues:

  1. Auto-scrolling works inconsistently, functioning only once or twice.

  2. Responses cease after two paragraphs, leading to the app freezing entirely.

  3. Continuous conversations are impossible due to frequent app freezes.

  4. A system message indicates 'Iris closed because this app has a bug. Try clearing the app's cache first, and then reopen the app.

  5. I've resorted to using it one prompt at a time, starting new chats, and trying different prompts due to constant crashes.

theglitcharchitect commented 4 months ago

Is this the end?

Kid-Kisuke commented 4 months ago

Update coming soon. crashing fixed on our end

theglitcharchitect commented 3 months ago

When is the new update coming?

AryanshuCreates commented 2 months ago

will be rolling out the release soon.

theglitcharchitect commented 2 weeks ago

Is this project abandoned?

Kid-Kisuke commented 2 weeks ago

It is not, we work on each project in cycles, which gives us dedicated time to make significant improvements. Iris will be updated soon, we were experimenting with other backends but the support is still limited for all but the most popular models. We will be updating without changing the backend soon.

List of planed Updates and Fixes (Status) in order of planned rollout:

  1. Fixing Crashes (Working)
  2. Support for any gguf model (Working)
  3. Shortening of model input like pruning or summarization (Working)
  4. Support for TTS (planned)
  5. Encoding on GPU (planned)