-
### Terraform Core Version
1.6.5
### AWS Provider Version
5.31.0
### Affected Resource(s)
Sagemaker Engpoint config.
### Expected Behavior
When creating a jumpstart endpoint through the SageMak…
-
配置:
系统:CentOS Linux release 7.9.2009
CUDA版本: 12.4
python版本: 3.11
NVIDIA-SMI :550.54.14
我在使用hello_world推理时遇到了这个问题,已经提示重新编译了bitsandbytes,但还是出现了这个问题。
问题如下:
CUDA SETUP: Something unexpected happ…
-
I'm currently trying out the ollama app on my iMac (i7/Vega64) and I can't seem to get it to use my GPU.
I have tried running it with num_gpu 1 but that generated the warnings below.
`
2023/11/…
-
### 🐛 Describe the bug
Hi,
We use `torch.compile` to run GPTJ3.6B model training on our GPU platforms, while we got some dynamo errors and the process aborted. The error is happening when runnin…
-
在评估tokenizer的部分给出的是tokenizer自身的评估指标,比如压缩率
但是,高压缩率的tokenizer并不意味模型的效果也更好,是否能给出最终模型层面的效果?
例如:sentencepiece实验中的BLUE
https://github.com/google/sentencepiece/blob/master/doc/experiments.md#english…
-
```gpt-researcher_1 | ERROR: Exception in ASGI application
gpt-researcher_1 | Traceback (most recent call last):
gpt-researcher_1 | File "/usr/local/lib/python3.11/site-packages/uvicorn/prot…
-
If I use the multiple strategies such as GPTQ + LLM-Pruner + LoRA, maybe the compressing ratio of LLM will be greatly improved with an acceptable performance?
-
Hello :)
Thank you for the excellent work and for sharing your code. I've learned a lot and have a few questions about the paper and settings:
- In Figures 2 and 3, what specifically do "prompt" …
-
## DSPy and ColBERT with Omar Khattab! - Weaviate Podcast - 85
[0:00](https://www.youtube.com/watch?v=CDung1LnLbY&t=0s) Weaviate at NeurIPS 2023!
[0:38](https://www.youtube.com/watch?v=CDung1LnLbY…
-
### Is there an existing issue for the same bug?
- [X] I have checked the troubleshooting document at https://docs.all-hands.dev/modules/usage/troubleshooting
- [X] I have checked the existing iss…