-
## Description
在使用OnnxRuntime引擎不会回收jvm内存
下面是代码,已经有很多使用者提出内存不会回收,不知道你们为啥这么自信你们一直没有问题,我们已经转到python在生产环境。你们有时间看下吧
```
mport ai.djl.Device;
import ai.djl.MalformedModelException;
import ai.djl…
-
## Description
本来是把djl推理yolov5模型整合到springboot项目中,压测发现内存无法回收,随着压测的增加内存也增加。
注意:和这个issues并不是一个问题https://github.com/deepjavalibrary/djl/issues/2800 ,它这个在main线程中执行确实不会有问题,但是异步执行就会有内存泄漏问题。
在spring项目中内存…
90600 updated
5 months ago
-
## Description
ignore_eos_token is commonly used additional parameter to help standardize LLM benchmarks by forcing the requests to generate a consistent output seq len.
-Will this change the c…
-
## Description
When I build a project supporting DJL in Android Studio, I encounter the following error. How can I resolve it?
`Could not resolve all files for configuration ':app:debugRuntimeClas…
-
I want to embed the block inside my network
-
sppe:file:/C:/Users/pc01/Desktop/SmartClassroomJava-master_new/SmartClassroomJava-master/target/classes/sppe
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-…
-
Any chance of getting a simple example (even just ad hoc ) on how to train mask rcnn via transfer learning on a custom Coco formatted dataset ?
We are currently evaluating if we need to write our …
-
## Description
The [SEP] token used in input for the Question Answering model "distilbert" of the DJL is returned as part of the extracted answer to the question.
Shouldn't be the answer extracted f…
-
,我试着使用DJL官网的教程,去生成djl的模型文件,可是全部失败了,所以想问一下大佬是怎么拿到的模型文件,或者如果大佬也是自己生成的模型文件,有可用的教程吗?
-
##Description
We have deployed a salesforce codegen-2b-multi model on a Nvidia GPU infrastructure with the following serving.properties
engine=MPI
option.rolling_batch=lmi-dist # tested with both…