search

latitude-dev / latitude-llm

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI
https://latitude.so
GNU Lesser General Public License v3.0
880 stars 57 forks source link

readme

Latitude Logo


The Open-Source Prompt Engineering Platform


See documentation →

Report Bug · Join Our Slack · X

🌈 Why Latitude?

Latitude is a platform that helps developers and product teams build AI features with confidence. Here's what it does:

  1. Makes prompts easier to manage: Instead of hiding prompts in code, Latitude lets everyone work on them together.
  2. Helps with testing: AI doesn't always return the same answer, which can be tricky. Latitude uses LLMs to check other LLM responses, looking for mistakes or off-topic answers.
  3. Provides insights: Offers detailed analytics on LLM request performance, including response times and cost comparisons across various AI models and prompt versions.

Latitude puts all these helpful tools in one place. This means you can add AI to your products without a lot of hassle, and keep an eye on how it's all working.

Latitude screenshot

✨ Features

📚 Table Of Contents

⚡ Quick start

Latitude offers two deployment options:

  1. Latitude Cloud: A fully managed solution that allows you to get started quickly without worrying about infrastructure.
  2. Latitude Self-Hosted: An open-source version that you can deploy and manage on your own infrastructure for complete control and customization.

Choose the option that best fits your needs and follow the corresponding instructions below.

Latitude Cloud

To get started with Latitude, follow these steps:

  1. Sign up for Latitude: Visit our website and follow the instructions to create your account.

  2. Create a new project: Once logged in, create a new project to organize your prompts and evaluations.

  3. Write your first prompt: Navigate to the Editor and create a new prompt. Start with a simple task, like generating a short story or answering a question.

  4. Test your prompt: Use the playground to test your prompt with different inputs and see the model's responses.

  5. Evaluate in batch: Before deploying, you can upload a dataset and run a batch evaluation to assess your prompt's performance across various scenarios.

  6. Deploy your prompt: Once you're satisfied with your prompt's performance in batch evaluation, deploy it as an endpoint for easy integration with your applications.

  7. Monitor and evaluate: Use the Logs section to review your prompt's performance over time. Set up ongoing evaluations to systematically assess and improve your prompt's output.

  8. Iterate and improve: Based on the evaluation results, refine your prompt or create new versions to enhance its performance.

  9. Collaborate with your team: Invite team members to your Latitude workspace to collaborate on prompt engineering and evaluations.

For more detailed information on each step, explore our documentation or join our community for support and discussions.

Latitude Self-Hosted

Follow the instructions in the self-hosted guide to get started with Latitude Self-Hosted.

After setting up Latitude Self-Hosted, you can follow the same steps as in the Latitude Cloud guide to create, test, evaluate, and deploy your prompts.

👥 Community

The Latitude community can be found on Slack where you can ask questions, voice ideas, and share your projects with other people.

🤝 Contributing

Contributions to Latitude are welcome and highly appreciated.

If you are interested in contributing, please join us on our Slack community, open an issue, or contribute a pull request.

📄 License

Latitude is licensed under the LGPL-3.0.

Alternatively, we offer a more permissive commercial license for those who need it. Please contact us at licensing@latitude.so for more information.

🔗 Links