-
I want to use TVM backend to compare runtime of TASO`s like above code.
```
def evaluate_runtime(onnx_model):
mod, params = relay.frontend.from_onnx(onnx_model, shape_dict)
lib = relay.b…
-
## ❓ General Questions
Hello,
I'm trying to build Android app with local customized (not on HuggingFace) **llava** model. I referred to those below guides:
https://llm.mlc.ai/docs/compilation…
-
The PyTorch model with `hardswish` operator and input_dtype=float64 crashed when load to relay.
## Actual behavior
```
data types float64 and float32 do not match in BroadcastRel
data types f…
-
현재 step function 시스템 내에서 성능 측정을 해보는 중입니다.
그 결과 예전에 arm tvm에서 추론 성능을 측정해보았을 때보다 성능이 정상적이지 않은 수준으로 안좋게 나오는 상황입니다.
inception_v3 | torch | onnx | tvm | torch | onnx | tvm
-- | -- | -- | -- | -- | -- | …
-
### This issue is to track progress for SVE upstreaming
- [x] P1. `vscale` builtin and its support in LLVM codegen - https://github.com/apache/tvm/pull/16484
- [x] P2. Support for scalable lanes in …
-
onnx_model = onnx.load(path_onnx)
model_shape = {"input": [1,3,224,224]}
model, params = relay.frontend.from_onnx(onnx_model, model_shape)
target = "llvm -mtriple=mipsel-linux-gnu"
compiler …
-
When I load a TFlite model with `relay.frontend.from_tflite` API, I get an AttributeError, as show below:
### Actual behavior
`Traceback (most recent call last):
File "tflite_main.py", line…
-
╰─ make cpptest ─╯
[ 2%] Built target p…
-
When applying optimization passes in TVM, there is a discrepancy in the results between directly applying opt_a(opt_b(mod)) and using a sequential optimization approach, where seq_ab = tvm.ir.transfor…
-
## ❓ General Questions
I'm trying to build a containerized application with vicuna-7b and mlc-llm for Jetsons with JP6. This is my multi-phase Containerfile:
```
FROM docker.io/dustynv/mlc:r36.…
oglok updated
1 month ago