[Good First Issue]: Verify gemma-7b-it with GenAI text_generation

[p-wysocki]

Context

This task regards enabling tests for gemma-7b-it. You can find more details under openvino_notebooks LLM chatbot README.md.

Please ask general questions in the main issue at https://github.com/openvinotoolkit/openvino.genai/issues/259

What needs to be done?

Described in the main Discussion issue at: https://github.com/openvinotoolkit/openvino.genai/issues/259

Example Pull Requests

Described in the main Discussion issue at: https://github.com/openvinotoolkit/openvino.genai/issues/259

Resources

• Contribution guide - start here!
• Intel DevHub Discord channel - engage in discussions, ask questions and talk to OpenVINO developers

Contact points

Described in the main Discussion issue at: https://github.com/openvinotoolkit/openvino.genai/issues/259

Ticket

No response

[VinayN18]

.take

[p-wysocki]

Hello @VinayN18, the ticket will be manually assigned to you shortly - the take feature hasn't been introduced to GenAI repo yet, but it will be today. :)

Thanks for taking a look at the issue!

[p-wysocki]

Hello @VinayN18, is there anything we could help you with?

[VinayN18]

Hello @p-wysocki I am working on it, I will let you know if I face any difficulties.

[VinayN18]

Hello @VinayN18, is there anything we could help you with?

Hello @p-wysocki I am facing memory issue when converting the gemma-7b-it model. I tried running the model in my local PC using Nvidia GeForce RTX 3050 Ti GPU and Google colab (free version) but due to the memory limit I was not able to convert it. I will try some other platforms and keep you posted. Could you also suggest any other methods to overcome this issue

[p-wysocki]

cc @pavel-esir

[Wovchena]

@VinayN18 any updates here? You don't need a dedicated GPU memory. Only RAM is needed to run it on CPU.

[Wovchena]

I unassigned the issue. Feel free to take it again if you are still working on it.