-
I updated Ollama from 0.1.16 to 0.1.18 and encountered the issue.
I am using python to use LLM models with Ollama and Langchain on Linux server(4 x A100 GPU).
There are 5,000 prompts to ask and get…
-
### 🐛 Describe the bug
Running Torch.compile with Llama7B and FSDP mixed precision, results in assert during first forward pass of training:
(you can repro by going to https://github.com/lessw2020/l…
-
### Feature Request
As demonstrated in this video https://youtu.be/QMaWfbosR_E there is a potential to use Retrieval Augmented Generation to redirect LLM calls to our own functions for specific use c…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and did not find a match.
### Who can help?
_No response_
### What are you working on?
I am trying to optimize w…
-
### Describe the feature
#Hi, I use the following packages:
colossalai 0.3.1
torch 2.0.1
transformers 4.28.1
#And the follwing command to run llama…
-
I am curious what is required to apply this method to the 70B parameter version of the llama2 model?
On reddit, noticed you mention: "For training, these models barely fit in 128 80GB A100s using Dee…
-
# Trending repositories for C#
1. [**fullstackhero / dotnet-webapi-boilerplate**](https://github.com/fullstackhero/dotnet-webapi-boilerplate)
__Clean Architecture Template for .NE…
-
At Acurast we're creating a distributed network of mobile devices that get dedicated to the network as compute units. The network currently counts 5000 mobile devices and it would be great to use dist…
dcale updated
1 month ago
-
我想利用这个模型做一个别的知识领域的rag。但是我改了提示词和build的文本。如下:
文本:
When Madison was growing up, she was a difficult child. “She was very
intense and moody. She would flip at the switch of the light—unpredictable…
-
### Describe the feature
I want to continue pre-training llama 2 70b using my own data. My data is about 1b tokens. I have read [Fine-tuning Llama 2 70B using PyTorch FSDP ](https://huggingface.co/bl…