-
## Description
Hello DJL Team,
I am currently using the SAM2 model from the DJL ModelZoo for inference purposes. However, I have encountered a couple of limitations that I would like to request …
-
I'm running vllm with:
- model = `meta-llama/Meta-Llama-3-8B-Instruct`
- DJL image = `763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.28.0-lmi10.0.0-cu124`
- the env of the deployed…
-
Checklist
- [x] I've prepended issue tag with type of change: [bug]
- [x] (If applicable) I've attached the script to reproduce the bug
- [x] (If applicable) I've documented below the DLC image/doc…
-
I've downloaded pre-trained model from [Github Repository](https://github.com/timesler/facenet-pytorch?tab=readme-ov-file), which is **20180402-114759-vggface2.pt**. I've used this in python and it is…
-
If we specify the frequency as required by the Lag class or as the GluonTS documentation says,
![image](https://github.com/deepjavalibrary/djl/assets/158003379/ff34d367-8ebc-401f-90e4-5b52d7e1d11f)
…
-
项目启动报文件未找到异常
java.io.FileNotFoundException: .onnx file not found in: C:\Users\Administrator\.djl.ai\cache\repo\model\undefined\ai\djl\localmodelzoo\ff986e01c27f72ffaa13a437c93668d56ff025e5
at ai.dj…
-
## Description
vLLM sampling parameters include a [richer set of values](https://github.com/vllm-project/vllm/blob/c9b45adeeb0e5b2f597d1687e0b8f24167602395/vllm/sampling_params.py), among which `lo…
-
### System Info
AWS g5.12xlarge (GPU 4 x NVIDIA A10G)
CPU x86_64
TensorRT-LLM v0.11.0
### Who can help?
@byshiue
### Information
- [X] The official example scripts
- [ ] My own modified scripts…
-
Because (see details https://github.com/awslabs/djl/releases/tag/v0.9.0)
![image](https://user-images.githubusercontent.com/5235127/102671861-d9a84f80-41e3-11eb-9768-b561bbb14664.png)
![image]…
-
```
An error occurred while building the embedding model
java.lang.Exception: java.util.ServiceConfigurationError: ai.djl.repository.zoo.ZooProvider: module org.jabref.merged.module does not declare…