-
When loading a ONNX model, the `getSessionOptions` function in ai/djl/onnxruntime/engine/OrtModel.java attempts to invoke "customOpLibrary" even when it is not specified in options:
https://github.co…
-
## Description
Hello,
I am currently looking into the possibility to fine-tune Hugginface transformers in DJL. I understand that now we have new hugginface tokenizer library and I tested the ex…
-
version:
ai.djl
api
0.21.0
ai.djl.nn.core.Linear#loadMetadata
this method Override parent#loadMetadata cause inputShapes not initialize
…
-
2023-08-14 11:43:52.609 INFO 22580 --- [ main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 1543 ms
2023-08-14 11:43:52.728 INFO 2258…
-
How to define BPRLoss and MarginLoss by DJL? Does there have some samples?
For PairWise data in recommender systems,
like user, pos_item, neg_item
I am already see the source of Loss in DJL, …
-
The reordering model ScoringModel currently only supports two types of online models. Can it be similar to OnnxEmbeddingModel to implement the use of OnnxScoringModel and local reordering models
-
Hi,
I use BatchPredict API for batch prediction, and when the input data shape is NDList size: 1,
0 : (2, 64) int32 or NDList size: 2 0 : (64) int32,1 : (64) int32, it will appear RuntimeError: …
-
作者大大你好,看到你的sdk就测试了以下,发现识别一张图片需要很长时间,如果文字多一点点就得快一分钟,如果采用多线程识别subImage,就会出现以下错误,应该是内存错误
还有就是调用batchPredict会出现以下错误
Failed to allocate CPU Memory
是不是我使用的方法错误,请问作者大大如何提高sdk识别速度。在多请求的情况下,如何保证效率输出
…
-
This tool currently supports the HF TGI container, and DJL Deep Speed container on SageMaker and both use the same format but in future other containers might need a different payload format.
Goal:…
-
Why is that data missing?