-
Can deepspeed-MII run on AMD GPU?
susie.sun@yz-amd1:~$ deepspeed --num_gpus 1 pipe.py
[2023-12-05 09:42:21,499] [INFO] [real_accelerator.py:161:get_accelerator] Setting ds_accelerator to cuda (aut…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
Hello,
before I start asking questions here, I would like to say thanks first. Among all AI projects related to this topic that I try, h2oGPT is always the fastest in terms of supporting new techn…
-
### Project description
The project entails the training and fine tuning of an open source Gen AI Large Language Model (LLM) designed to function as a primary mentor and educator within the mainframe…
-
Please let us know what model architectures you would like to be added!
**Up to date todo list below. Please feel free to contribute any model, a PR without device mapping, ISQ, etc. will still be …
-
Hi,
Thanks for releasing this work! Are there any plans to release a Mistral version?
Thanks!
-
**Describe the bug**
Jan uses GLIBCXX_3.4.30 which is a symbol that doesn't exist for standard packages on ubuntu 20.04 libstdc++.so.6.
An extract from the error logs:
```
jan-data-folder/ex…
-
Trying to run the [colab](https://colab.research.google.com/drive/19lwcRk_ZQ_ZtX-qzFP3qZBBHZNcMD1hh?usp=sharing#scrollTo=2eSvM9zX_2d3) using a small model:
```python
from unsloth import FastLangua…
-
7b is > 12gb ram use, can u do one that is maybe 3b parameters or have one 7b whose quantisation is 4_0 gguf or something?
-
### #
- [ ] I have searched the existing issues
### Current behavior
error log below
btw. same model and same mmproject-file works with koboldcpp , may you can copy paste ;)
### Minimum repro…