ai-for-java / ai4j

Apache License 2.0
26 stars 3 forks source link

[Feature] Async calls to LLMs #24

Open deep-learning-dynamo opened 1 year ago

deep-learning-dynamo commented 1 year ago

As a user of the library I want to have an ability to call LLM and receive response asynchronously (without blocking) into provided callback.