-
Some users may want to avoid having to code their beam models in C++ and recompile the software. One solution would be to implement a 'generic beam model' that allows the specification of settings via…
-
I try to convert a simple network with QuantizeLinear/DequantizeLinear but it fails.
The network is very simple that it only contains one tensor as input. Its definition could be found in test of p…
-
As per #1 CC-BY is chosen as the default licence for the model zoo entries. However, this might not be compatible with the licence of the training dataset that was used to compute the weights.
OASI…
-
On [this build](https://github.com/leejet/stable-diffusion.cpp/releases/tag/master-760cfaa) most of the lora's i have will cause a black image as an output.
I'm not entirely sure why this would be th…
-
#### Issue description
I am experiencing issues when importing Catalyst that seem to depend on where and how the library is imported. It might be specific to my installation (I had to hack around a…
-
Hello!
Does TensorRT-LLM supports Medusa with Mixtral 8x7B?
My understanding is that right now the Medusa [convert_checkpoint.py](https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/medusa/c…
-
I've been trying to run darknet with various combinations of CUDA and cuDNN but there is always something that goes wrong. If I end up fixing compilation errors, I get "Floating point error" or "Float…
-
From @tqchen in https://github.com/webmachinelearning/webnn/issues/375#issuecomment-1803950944:
>Great to see this thread, as part of of WebLLM project https://github.com/mlc-ai/web-llm We are also…
-
https://github.com/rieck/malheur of @rieck as in cuckoo modification of @brad-accuvant https://github.com/brad-accuvant/cuckoo-modified
-
Hello!
Trying to run the code I've reached CppMNIST absence problem. How it should be organized? Where I can take the folder sources?
Sincerely,
Evgeniy Pavlovskiy, leading researcher @ SDAML NSU…