hard to add this plugin using lazy.nvim with the container option setting.

[meicale]

I need to use the docker container to serve my custom model and it works when using ollama docker images. BUT, when come to using it in this plugin, it is difficult to set up the container value in lazy.nvim package manager. Can you provide more code snips to using different config setting ups? Thanks for your time and effort on time good project.

[meicale]

It should be just as simple as this and it helps the beginner to start：

{ 
    "David-Kunz/gen.nvim",
    config = function()
      require('gen').container = 'ollama_gpu'
      -- require('gen').model = 'zephyr'
    end,
  },

[David-Kunz]

Hi @wishuuu ,

Could you help this user? Shouldn't it be enough to set the container property? I must admit, I haven't tested it yet.

[wishuuu]

Hi @meicale !

Here is code snippet from my lazy config:

https://github.com/wishuuu/nvim-pure/blob/main/lua/wishu/plugins/gen.lua

Honestly it's hard to tell what may be wrong with your config. Can you check if docker exec ollama_gpu ollama run zephyr TEST returns any error in your case? Also are you using Linux or Windows?

[kjjuno]

There is now a traditional setup function. Does that resolve this issue?

[David-Kunz]

Hi @meicale ,

The docker option was removed since we switched to HTTP-based communication. You should be able to specify the init function to start your docker container and use port forwarding to communicate with it.

Best regards, David