Closed cdll closed 2 months ago
ok, i figured it out. in the configureGenkit.plugins[0].ollama.models
, we should set name
to gemma:7b
, and in the defineFlow
's async callback we should use model: 'ollama/gemma:7b'
in the generate
method.
thats all, thanks~
Describe the bug when i click [Run] on the flow, there is an error showing that
model 'gemma' not found, try pulling it first
To Reproduce following the genkit init steps and use the default ollama way to start
genkit start
. (in fact i 've got ollama installed and serving, and gemma:7b has been pulled beforeollama serve
)Expected behavior start my flow rightly (or show me how to check my ollama models are ready for genkit.
Screenshots .
Runtime (please complete the following information):
** Node version
v18.19.1
Additional context can the ollama plugin be more easier to debug.