Open waicool20 opened 1 year ago
@waicool20
ai.djl.pytorch:pytorch-native-auto
is no longer needed, simply remove it will workSeems like that works, the GPU inference is fine, but when i force it to use cpu by adding to gradle:
implementation("ai.djl.pytorch:pytorch-native-cpu:1.13.0:linux-x86_64")
it hangs up with a very non-descript error:
Program aborted due to an unhandled Error:
Unable to find target for this triple (no targets are registered)
The error seems related to your jit traced model with PyTorch 1.13.0: https://discuss.pytorch.org/t/calling-forward-on-torchscript-model-multiple-times-leads-to-error/154990/3
Can you try PyTorch 1.12.1?
1.12.1 does not work, neither does 1.11.0
That link indicates it fails on multiple forwards, but this happens on the first forward/predict call
Can you try it with python:
python3 -m pip install torch==1.13.0+cpu -f https://download.pytorch.org/whl/torch_stable.html
Description
Some files are failing to download after updating pytorch-engine to 0.20.0, the files aren't on your cloud instances so DJL just throws an error
Expected Behavior
Downloads properly
Error Message
How to Reproduce?
I've changed a simple application from
to
Steps to reproduce
Just launch a simple program with this line to initiate the process to load the native libraries
What have you tried to solve it?
These are missing files on your servers I assume, so nothing can be really done other than rollback...
Environment Info
N/A