-
有没有训练好的权重啊,可以直接进行对话的
-
Hi, Thanks for the quantization now i can try phi2 in mlx
But I found out that when the phi2 is typing (longer context) - the memory usage is growing up quickly (I'm using m2 pro 16gb) - and realiz…
x4080 updated
7 months ago
-
I already downloaded phi3 instruct gguf from: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf/resolve/main/Phi-3-mini-4k-instruct-q4.gguf
and placed it at: ~/models/
jawad@desktoper:~…
-
我用以下的代码来加载microsoft-phi2,
`from airllm import AutoModel`
报错:
```
270, in split_and_save_layers
if max(shards) > shard:
^^^^^^^^^^^
ValueError: max() arg is an empty sequence
```
-
I installed llamacpp using the instructions below:
CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python
the speed:
llama_print_timings: eval time = 81.91 ms / 2 runs ( 40…
-
**Describe the bug**
I'm using `ftable` to render a 3d array, but when I pass the output of `ftable` to `kbl`, I get an error about bad arguments to an internal `sprintf` function.
**To Reproduc…
-
I am following the run_simpo.py and running it in my system on a custom dataset (prepared in a similar format). I am getting the above mentioned error. I also tried to initialize ref_model_init_kwargs…
-
when I upload a folder, and it fails in the middle of a file, I would like it to automatically resume where it left off the next time I try to upload it.
ie:
```
$ huggingface-cli upload cognit…
-
I am Trying to Load Phi2 GGUF Model via `llama-cpp-python` dependency
The Model I am trying to load is this:
https://huggingface.co/TheBloke/phi-2-GGUF
I am Getting this Error while I am trying …
-
#### Description
I ran the following and observed an error
1. Created a new condo env
```
conda create -q -n mlx-examples python=3.8
conda activate mlx-examples
```
2. Ran pip install from …