-
Hi, I'm a student at the University of Bologna ( Italy) and I'm using the Google Coral USB accelerator for my thesis. I realized a keras neural network that classifies my data in four classes and the …
-
Hello, so I cloned the hwpe-tb project and followed the steps mentioned in README.
I can see the following simulation output:
![hwpe-tb questa](https://github.com/pulp-platform/hwpe-tb/assets/75566…
-
微博内容精选
-
- [ ] [blog/starcoder2.md at main · huggingface/blog](https://github.com/huggingface/blog/blob/main/starcoder2.md?plain=1)
# blog/starcoder2.md at main · huggingface/blog
---
## StarCoder…
-
I am trying to feed the INT8 inputs.
The every examples on the google uses the float(fp32) inputs, not the int8 one.
I have ONNX model which is trained on float(fp32) precision data, and calibra…
-
Hi i need some information. could you please respond.
Does llama.cpp uses dynamic range calibration.
> Dynamic Range Calibration is a technique used in quantization, primarily for neural networ…
-
# Overview
Status: https://github.com/apache/incubator-mxnet/projects/18
The status for each project will be updated by the contributor who's driving it. If you have more projects that you intend …
-
In this recent [EXL2 vs GGUF](https://old.reddit.com/r/LocalLLaMA/comments/17w57eu/llm_format_comparisonbenchmark_70b_gguf_vs_exl2/) discussion, one stand-out comment was [this one by llama_in_sunglas…
-
https://github.com/ModelTC/Outlier_Suppression_Plus/blob/3ba97ae2dab0e6e5ead5da1795f50fd47025a49d/quant_transformer/model/quant_llama.py#L242 hi~ i noticed that there are two types LN i.e. pre-LN&pos…
-
I have learned quanto calibrate ops in module forms by adding module hooks, but how about torch functions like `torch.sigmoid`, `torch.elu`, and `torch.log` etc?
I think the output scale of `torch.si…