-
微博内容精选
-
## NOTE: We are currently working on this major change in the branch `js-backend`.
Many users have requested being able to use ChainForge directly from the browser, without `pip install`.
To hos…
-
test
-
I tried this on 8 A100 GPUs (40GB) and it OOMed. Any pointer on how to run inference with very big models?
```
python main.py --model hf-causal-experimental --model_args pretrained=huggyllama/llama-…
-
Hi,
Thanks for releasing the model. I recently have similar findings of this paper (https://arxiv.org/pdf/2305.17926.pdf) when using LLM as evaluator. That is, when I flip the order of response, th…
-
Hi,
I am wondering if you tried other public LLMs like Vicuna except GPT3.5 and GPT4? How about the performance? Thanks?
-
Hi,
i am trying to build bitsandbytes on a Nvidia Jetson AGX Xavier Kit, but it fails, not finding emmintrin.h:
`/home/g/bitsandbytes# CUDA_VERSION=114 make cuda11x_nomatmul`
>ENVIRONMENT
=…
-
**Hi hope u are below i m facing this errors when calling :
POST
[/api/v1/question](/docs#/Question/answer_question)**
parameter :
{
"db_connection_id": "XXXXXXXX",
"question": "list all …
-
When running below snippet -
python main.py \
--model hf-causal \
--model_args pretrained=EleutherAI/gpt-j-6B \
--tasks hellaswag \
--device cuda:0
Getting this error -
…
-
### Prerequisite
- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expe…