lunary-ai / lunary

The production toolkit for LLMs. Observability, prompt management and evaluations.
https://lunary.ai
Apache License 2.0
1.09k stars 135 forks source link
ai evaluation hacktoberfest langchain llm logs monitoring observability openai prompts self-hosted testing

Lunary Logo

# lunary **Developer toolkit for LLM chatbots** [website](https://lunary.ai) - [docs](https://lunary.ai/docs) [![npm version](https://badge.fury.io/js/lunary.svg)](https://badge.fury.io/js/lunary) ![PyPI - Version](https://img.shields.io/pypi/v/lunary) ![GitHub last commit (by committer)](https://img.shields.io/github/last-commit/lunary-ai/lunary) ![GitHub commit activity (branch)](https://img.shields.io/github/commit-activity/w/lunary-ai/lunary)

Features

Lunary helps developers of LLM Chatbots develop and improve them.

It also designed to be:

1-min Demo

https://github.com/lunary-ai/lunary/assets/5092466/a2b4ba9b-4afb-46e3-9b6b-faf7ddb4a931

โš™๏ธ Integration

Modules available for:

Lunary natively supports:

Additionally you can use it with any other LLM by manually sending events.

๐Ÿ“š Documentation

Full documentation is available on the website.

โ˜๏ธ Hosted version

We offer a hosted version with a free plan of up to 10k requests / month.

With the hosted version:

Running locally

  1. Clone the repository
  2. Setup a PostgreSQL instance (version 15 minimum)
  3. Copy the content of packages/backend/.env.example to packages/backend/.env and fill the missing values
  4. Copy the content of packages/frontend/.env.example to packages/frontend/.env and fill the missing values
  5. Run npm install
  6. Run npm run migrate:db
  7. Run npm run dev

You can now open the dashboard at http://localhost:8080. When using our JS or Python SDK, you need to set the environment variable LUNARY_API_URL to http://localhost:3333. You can use LUNARY_VERBOSE=True to see all the event sent by the SDK

๐Ÿ™‹ Support

Need help or have questions? Chat with us on the website or email us: hello [at] lunary.ai. We're here to help every step of the way.

License

This project is licensed under the Apache 2.0 License.