Quarkus LangChain4j

This repository contains Quarkus extensions that facilitate seamless integration between Quarkus and LangChain4j, enabling easy incorporation of Large Language Models (LLMs) into your Quarkus applications.

Features

Here is a non-exhaustive list of features that are currently supported:

Declarative AI services
Integration with diverse LLMs (OpenAI GPTs, Hugging Faces, Ollama...)
Tool support
Embedding support
Document store integration (Redis, Chroma, Infinispan...)
Native compilation support
Integration with Quarkus observability stack (metrics, tracing...)
Pluggable auth providers

Documentation

Refer to the comprehensive documentation for detailed information and usage guidelines.

Samples

Check out the samples and integration tests to gain practical insights on how to use these extensions effectively.

Getting Started

To incorporate Quarkus LangChain4j into your Quarkus project, add the following Maven dependency:

<dependency>
    <groupId>io.quarkiverse.langchain4j</groupId>
    <artifactId>quarkus-langchain4j-openai</artifactId>
    <version>{latest-version}</version>
</dependency>

or, to use Ollama:

<dependency>
    <groupId>io.quarkiverse.langchain4j</groupId>
    <artifactId>quarkus-langchain4j-ollama</artifactId>
    <version>{latest-version}</version>
</dependency>

Make sure to replace {latest-version} with the most recent release version available on Maven Central.

Contributing

Feel free to contribute to this project by submitting issues or pull requests.

License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.

quarkiverse / quarkus-langchain4j

readme