With Gemma 2
A family of lightweight, state-of-the art open models built from the same research and technology used to create the Gemini models. INFO: https://ai.google.dev/gemma
Works with the CPU, but is highly recommended with nvidia cards. RTX-3060
Ollama, a platform that makes local development with open-source large language models a breeze. With Ollama, everything you need to run an LLM—model weights and all of the config—is packaged into a single Modelfile
There are a large number of models that can be tried
Meta Llama 3: The most capable openly available LLM to date
deepseek-coder-v2 An open-source Mixture-of-Experts code language model that achieves performance comparable to GPT4-Turbo in code-specific tasks.
With Gemma 2 A family of lightweight, state-of-the art open models built from the same research and technology used to create the Gemini models. INFO: https://ai.google.dev/gemma
INSTALLATION
C:\Users\myuser> ollama run gemma2
(Automatic Download Model Gemma2 5GB)Works with the CPU, but is highly recommended with nvidia cards. RTX-3060
Ollama, a platform that makes local development with open-source large language models a breeze. With Ollama, everything you need to run an LLM—model weights and all of the config—is packaged into a single Modelfile
There are a large number of models that can be tried Meta Llama 3: The most capable openly available LLM to date deepseek-coder-v2 An open-source Mixture-of-Experts code language model that achieves performance comparable to GPT4-Turbo in code-specific tasks.
https://ollama.com/library