-
A user reported the following:
"A strange behavior of NetLogo with a MacBookPro M3 computer running Sonoma: both large and very small NetLogo applications suddenly become blocked, not responding eit…
-
We should show warnings for models that users will likely not be able to run based on their hardware.
We can check the system's hardware information with [sysinfo](https://docs.rs/sysinfo/latest/s…
-
**Describe the bug**
When GNOME's Large Text Accessibility option is enabled, the content of the 'Manage Models' window is larger than the window itself. Horizontal scrolling is required to view th…
-
### What happened?
On compiling a model with int8 quantization one of the dispatches fails to compile with the following error:
```
error: One or more operations with large vector sizes (16384 …
-
I want to quantize the CodeQwen model using a custom dataset, but all sample lengths exceed 512. Why doesn't AWQ support sample with lengths longer than 512? Are there any alternative methods for quan…
-
Hi, thank you for great work and efforts.
Current kernels seem to support only dimensions of 7B models with hidden dimension 4096.
How can I extend it for larger models like Llama-30B or 65B?
It …
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
Hi, I have a small feature request that could further improve the user experience, especially for those _(like me)_ who manage to have a large number of models locally.
I currently have **over 250…
-
Are there any plans to train or release larger-scale models, such as those based on the ViT-G architecture?
-
`---------------------------------------------------------------------------
NotImplementedError Traceback (most recent call last)
Cell In[15], [line 2](vscode-notebook-cell:?e…