-
Has anyone tried running the Llama2 (https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML)model? After I load the model, the APP immediately crashes after sending out the prompt.
-
File "/gpfs01/unifiedcsi/gpfs/csi-dfs-ti-platform-fs/wcp/vllm_test/torchtune/Pai-Megatron-Patch/examples/llama2/pretrain_megatron_llama.py", line 110, in train_valid_test_datasets_provider
[rank2]: …
-
This needs abstracted to clean it up a bit and make this less expansive. 👍
```typescript
const modelProgressController = ModelProgressController.getInstance();
const models = await modelProg…
jwafu updated
6 months ago
-
Hi,
If I get it correctly, you have used code from https://github.com/allenai/open-instruct as base.
Would you release the full code of reproducing llama2 pro 8B?
Thanks!
-
I want to use the demo to get some answers for a video. Unfortunately, the output I got using your demo seem not to be the answers for the input text-query as follows(the last line is the output)
!…
-
预训练的 MiniGPT-4 检查点是否可以提供llama2 7b和13b的
-
Dear FastChat developer,
Greetings! I am vansinhu, a community developer and volunteer at InternLM. [InternLM](https://github.com/InternLM/InternLM) is a large language model similar to llama2, and w…
-
Hi. I am attempting to run the shared codebase. I was testing the negotiation task given in the paper with a language model of my choice (LLAMA2). I am not sure how to obtain the RL Model accuracy (g…
-
how to load llama checkpoints, can it load checkpoints from those downloaded from huggingface?
-
```python
from transformers import AutoTokenizer, AutoModelForCausalLM, AutoConfig, GenerationConfig
# from vllm import LLM, SamplingParams
import torch
device = torch.device(0)
def load_t…