-
reference: https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/blogs/quantization-in-TRT-LLM.md#performance
File "/home/gongai/projects/wgong/PromptFix/./stable_diffusion/ldm/modules/attention.py", li…
wgong updated
7 hours ago
-
We found that [evaluation.py](https://github.com/mlcommons/inference/blob/master/language/gpt-j/evaluation.py) is not deterministic.
I narrowed down to small and fast reproducer using 100 examples …
-
The script [https://github.com/mlcommons/inference/tree/master/language/gpt-j](https://github.com/mlcommons/inference/tree/master/language/gpt-j) refers to [https://github.com/badhri-intel/inference](…
-
Feature request
Nous Research and EleutherAI have released the YaRN model, which comes in two versions with context sizes of 64k and 128k. This model utilizes RoFormer-style embeddings, distinguishin…
-
:
return np.random.randn(M,r) @ np.random.randn(r,M)
r_step = range(2,1…