macai

macai (macOS AI) is a simple yet powerful native macOS client made to interact with modern AI tools (ChatGPT- and Ollama-compatible API are supported).

Downloads

You can download latest binary, notarized by Apple, on Releases page.

You can also support project on Gumroad.

Build from source

Checkout main branch and open project in Xcode 14.3 or later

Features

ChatGPT/Ollama and other compatible API support
Customized system messages (instructions) per chat
System-defined light/dark theme
Backup and restore your chats
Customized context size
Any LLM with compatible API can be used
Formatted code blocks with syntax highlighting
Formatted tables with copy as CSV and as JSON functions
Formatted equations
Data is stored locally using CoreData
Streamed responses
Automatically generate chat names

Run with ChatGPT

To run macai with ChatGPT, you need to have ChatGPT API token. You can get it here. Add the token to the settings and you are ready to go. Note: by default, gpt-4o model is selected. You can change it in the New Chat settings.

Run with Ollama

Ollama is the open-source back-end for various LLM models. Run with Ollama is very easy:

Install Ollama from the official website
Follow installation guides
After installation, select model (llama3 is recommended) and run ollama using command: ollama run llama3
In macai LLM settings, set ChatGPT/LLM API Url to http://localhost:11434/api/chat:
In macai New Chat settings, set model to llama3
Changing default instructions is recommended
Test and enjoy!