Open KosuriSireesha opened 1 month ago
Hi @KosuriSireesha,
Could you please try running this sample app frome her https://github.com/google-ai-edge/mediapipe-samples/tree/main/examples/llm_inference/android and let us know if you encounter the same issue there as well?
Thank you!!
Hi @kuaashish , Yes , I do tested the sampleapp from https://github.com/google-ai-edge/mediapipe-samples/tree/main/examples/llm_inference/android
Issue is still reproducible
Note :On com.google.mediapipe:tasks-genai:0.10.11 , GPU model is working fine .On 0.10.14 version it failed .
Reopened the issue .
Hi @PaulTR,
Could you please look into this issue? Currently, we do not have a real device to reproduce it. Additionally, we are not sure if the issue is specific to a particular device. It seems that the sample app is also behaving the same way based on the input received.
Thank you!!
Have I written custom code (as opposed to using a stock example script provided in MediaPipe)
No
OS Platform and Distribution
Android 14
Mobile device if the issue happens on mobile device
Android Mobile device (Motorola edge 50 Ultra)
Browser and version if the issue happens on browser
No response
Programming Language and version
Kotlin
MediaPipe version
0.10.14
Bazel version
No response
Solution
LLMInference
Android Studio, NDK, SDK versions (if issue is related to building in Android environment)
No response
Xcode & Tulsi version (if issue is related to building for iOS)
No response
Describe the actual behavior
Gemma GPU model giving Junk output from the 2nd query
Describe the expected behaviour
Model needs to give relevant response to the user Query
Standalone code/steps you may have used to try to get what you need
Other info / Complete Logs