search

quarkusio / quarkus

Quarkus: Supersonic Subatomic Java.
https://quarkus.io
Apache License 2.0
13.64k stars 2.64k forks source link

DJL extension (specially for native compilation) #40137

Open lordofthejars opened 5 months ago

lordofthejars commented 5 months ago

Description

After delivering my session in DevNexus, two devs approached me asking on how to compile a Quarkus + DJL library into native, as DJL library already supports GraalVM compilation https://docs.djl.ai/docs/demos/graalvm/index.html but couldn't make it run together with Quarkus. I expect that if in a session of 80 people, 2 approached me with the same question, probably there are many more people facing the same problem.

Also I noticed, that most of the people were more interested in Training and Inferencing models rather than consuming models (LangChain4J), I am not saying it was not important but mot people were interested in the inferencing stuff with DJL.

I think the extension can or not provide DJL integration into Quarkus, but native compilation might be main focus.

Repository name

quarkus-djl

Short description

An extension for DJL AI framework.

Repository Homepage URL

https://quarkiverse.github.io/quarkiverse-docs//dev/

Repository Topics

Team Members

Additional context

No response

quarkus-bot[bot] commented 5 months ago

/cc @zakkak (native-image)