-
I am stuck with this error. I have a torch model and wanted to test the performance of TVM on this torch model. For this I converted the torch model in onnx format and then followed same procedure as…
-
## Problem Description
FlexCNN uses 512-bit global input output bus but implementing it in HeteroCL causes TVM error in `src/pass/arg_binder.cc`.
`hcl.UInt(512)` seems to generate `uint0` buffer w…
-
https://replicate.com/p/yzcvd2ublijzruz4nxkznwpbqe
## Output
```
Prediction failed.
Traceback (most recent call last): 7: mlc::llm::LLMChatModule::GetFunction(tvm::runtime::String const&, tv…
zeke updated
6 months ago
-
Hi octoml team
Running this command failed on `JSONReader: Unknown field global_key, candidates are:`
```
$ python3 -m model.kws.kws --test 1000 --module model/kws/saved/module_gs_4.0.pickle --…
insop updated
3 years ago
-
### Expected behavior
I am following the instructions for AoT compilation of AI models [here](https://github.com/apache/tvm/tree/main/apps/bundle_deploy). Specifically, I built `tvm` from source wi…
-
We may want to eventually extend the attestation TG-ABI to support data sealing.
The generic use-case for sealing is basically for a TVM to seal a piece of data that can be migrated to and unsealed…
sameo updated
6 months ago
-
Thanks for your excellent work!
Just want to discuss the memory reduction problem. It seems that the TVM implementation does not store fewer matrices (like Queries, Keys, and Values matrix). The n…
-
TVM里的推导有点复杂,直接讲中文了哈。我仔细读了TVM部分的代码,发现反向传播部分有一个part好像有点问题,希望能和作者讨论一下。
https://github.com/alipay/Pyraformer/blob/84af4dbd93b7b96975b5034f0dde412005260123/pyraformer/hierarchical_mm_tvm.py#L74-L77
这个部…
jlidw updated
2 years ago
-
I quantized a custom fine-tuned llama2 70b model like this.
```bash
$ python main.py \
--model /data/finetuned_llama2_70b \
--epochs 20 \
--output_dir /data/finetuned_llama2_70b_output \…
-
For simplicity, clarity, and, in some regard, conformance to `grammar.ohm`, I propose renaming of many terms throughout the docs.
Changes:
* global static functions -> global functions
* internal…