intitni / CopilotForXcode

The missing GitHub Copilot, Codeium and ChatGPT Xcode Source Editor Extension
Other
7.34k stars 347 forks source link

[Bug]: Gemma 2 responses broken #548

Open cliffordh opened 3 days ago

cliffordh commented 3 days ago

Before Reporting

What happened?

I am using Gemma 2 9B via Ollama. When chatting the first part of the response is ok, but then degrades as shown into just showing boxes.

Screenshot 2024-06-28 at 7 13 30 AM

How to reproduce the bug.

Setup Gemma 2 for Ollama "ollama run gemma2". Configure a chat model for Gemma 2. I have token size set to 16384. I have 5 message history turned on for the Chat feature and this custom prompt (Note "Reply in Markdown"): You are an AI programming assistant. You understand and respond in English. You are using iOS 17 to develop a SwiftUI health and wellness application using HealthKit and WidgetKit with a companion Apple Watch app. Your reply should be clear, concise and logical. Use best practices. Do not use deprecated functions (below iOS 17). Do NOT force unwrap optionals. Reply in Markdown with brief code explanations.

Relevant log output

No response

macOS version

14.5

Xcode version

15.4

Copilot for Xcode version

0.33.4

intitni commented 3 days ago

Hello, it seems to work for me. What is the temperature in your settings? Are you using Ollama 0.1.47?