-
### Description
Hi, I am using the latest version of LLamaSharp and my model is Llama-3 70b gguf version, when the number of GpuLayerCount is 0 to 5, although it is not very fast, I get the answer, b…
-
## ⚙️ Request New Models
- Link to an existing implementation (e.g. Hugging Face/Github): https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf
- Is this model architecture supported by ML…
-
Dear @flowersteam,
trying to reproduce your results for coursework.
I find there are a number of issues in running the code. Here is a list of what I found so far.
## Importing
Several files…
-
****
When running the command `tune run generate ./custom_quantization_generation_config.yaml`, I encountered the following error:
`AttributeError: module 'torchtune.utils' has no attribute 'gen…
-
### Motivation
Support Maximal Update Parametrization as it could help get optimal HPs from small proxy models and apply them on large LLMs
Is there any plan for adding this feature?
More details, …
-
Thanks for the incredibly clean repository!
I am Sayak from the [Diffusers](https://github.com/huggingface/diffusers) team at Hugging Face. My question is probably very naive, so I apologize for th…
-
I noticed in the paper that 'In total, we collected 2,000 malicious documents for training with an average number of tokens of 702.79'. However, I do not find these malicious documents within the repo…
-
Issue Description
Problem: When using the mix generate text command with verbose set to false, and the following parameters:
Temperature: 0.1 or 0
Top p: 1
The LLM models seem to hallucinate mor…
-
hi authors, thanks for the great work!
i just wonder if LR=1e-3 for mup is optimal value from small-scale proxy model
and how dropout is critical for multi-epoch training.
for the latter, i guess y…
-