-
Hello-
I've been looking into hosting an LLM on AWS Infrastructure. I am mainly looking to host Flan T5 XXL. My question is below
Inquiry: what is the recommended container for hosting Flan T5 X…
-
**Description**
Would be nice to have quarkus-extensions for the following frameworks:
- https://github.com/awslabs/djl (Deep Java Library)
- https://github.com/eclipse/deeplearning4j
- https://…
-
## Description
Currently, in docs for time series forecasting, the air passengers model is used to show how to inference a time series model using DJL. However, the model is already trained. Then, …
-
## Description
I tried `.optOptions(Collections.singletonMap("enableMKLDNN", "true"))` to create [Criteria](https://github.com/mymagicpower/AIAS/blob/f3bc2929b7bef62b15a1cfe76fb1f0d5ad729059/1_image…
-
Does DJL have a gnn?
-
I am using OnnxRuntime extensions 0.11.0 in Java via DJL, and while this all works fine on Linux, the same code on Windows fails during initialisation on the `OrtSession.SessionOptions.registerCustomO…
-
sppe:file:/C:/Users/pc01/Desktop/SmartClassroomJava-master_new/SmartClassroomJava-master/target/classes/sppe
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-…
-
,我试着使用DJL官网的教程,去生成djl的模型文件,可是全部失败了,所以想问一下大佬是怎么拿到的模型文件,或者如果大佬也是自己生成的模型文件,有可用的教程吗?
-
In djl.jupyter.load_pytorch_model.ipynb,when I am running
"
Criteria criteria = Criteria.builder()
.setTypes(Image.class, Classifications.class)
.optModelPath(Paths.get("build/p…
-
##Description
We have deployed a salesforce codegen-2b-multi model on a Nvidia GPU infrastructure with the following serving.properties
engine=MPI
option.rolling_batch=lmi-dist # tested with both…