-
Hello, I have a few questions about OctoCoder.
For this part in the paper:
> For instruction tuning our models, we select 5,000 random samples from COMMITPACKFT across the 6 programming languages…
-
after I do "python3 convert-hf-to-ggml.py bigscience/bloomz-7b1 ./models ",there was a problem loading the model:
```
model_path = "/aidata/yh/BelleGroup_BELLE-7B-1M-fp16/" # You can modify the path…
-
### System Info
Python 3.9.2
transformers 4.30.2
### Who can help?
@gante
### Information
- [X] The official example scripts
- [X] My own modified scripts
### Tasks
- [X] An officially support…
-
## Description
Multi model endpoint deployment in sagemaker through DJL serving is supposed to be supported. Here is the related [AWS page](https://docs.aws.amazon.com/sagemaker/latest/dg/deploy-mode…
-
* CodeCarbon version: 2.7.1
* Python version: 3.10.14
* Operating System: Linux
### Description
I'm trying to estimate the carbon impact of LLM using available models on hugging face. So far I'm…
-
Hi there.
My Cloud Atlas project will be using Bloomz, and I plan to incentivize all of my future users to run Petals on their machines.
But the first entry is not flawless, even i have problem…
-
### System Info
```shell
optimum-habana 1.14.0.dev0
HL-SMI Version: hl-1.18.0-fw-53.1.1.1
Driver Version: 1.18.0-ee698fb
```
### Information
- [X] The off…
-
### System Info
The bug as described below occurs locally on my system with the following specs, and on google colab (see below for reproducible example):
```shell
- System: Ubuntu 22.04.3 LTS
…
-
in windows
replacing private.dockerfile with:
```
FROM hyperonym/basaran:0.15.3
# Copy model files
COPY vicuna128 D:\basaran\models\vicuna128
# Provide default environment variables
ENV MO…
-
**LocalAI version:**
1.22.0
**Environment, CPU architecture, OS, and Version:**
WSL Ubuntu via VSCode
Intel x86 i5-10400
Nvidia GTX 1070
Windows 10 21H1
uname -a output:
Linux DESKTO…