-
I am able to load quantised_mistral
For the model_id and revision I have chosen this
```
let model_id = "mistralai/Mistral-7B-v0.1".to_string();
let revision = "26bca36bde8333b5d7f72e9ed20ccda6a…
-
Currently the napari workflow format uses strings as arguments, either to name tasks that they depend on, or as literal strings. If the workflow is "complete", ie all the dependencies are specified, t…
-
### Author Pages
https://aclanthology.org/people/y/yifan-wang/
### Type of Author Metadata Correction
- [X] The author page wrongly conflates different people with the same name.
- [ ] This author …
-
The Orchestra spec does not include a description of all attributes. Some are only defined in the XSD file. The following attributes should be added to the spec together with a description:
- Attri…
-
Oogabooga text-generation-web-ui engine used for inference (prompts directly input into the oogabooga ui produce normal results but chat-ui is doing something weird as below), Mongodb setup
_**Prom…
-
python test_truthfulqa.py --is_KG=True
Traceback (most recent call last):
File "/root/zhangyf/KnowLA/test_truthfulqa.py", line 206, in
fire.Fire(main)
File "/opt/anaconda3/envs/llm_env…
-
Hi!
I'm using Fixture Monkey version 1.0.4. I updated it to the latest version, but some of my unit tests started to fail.
Basically I have a class excluded from generation, like the example sho…
-
I did a fine-tune and training for audioWhisper but get following error when running the /generate endpoint.
```
The attention mask and the pad token id were not set. As a consequence, you may ob…
-
### New Issue Checklist
- [x] Updated fastlane to the latest version
- [x] I read the [Contribution Guidelines](https://github.com/fastlane/fastlane/blob/master/CONTRIBUTING.md)
- [x] I read …
-
So, I've been testing to generate text using exllamav2 with some config following huggingface generator. Here is my script
```python
import torch, os
from contextlib import contextmanager
from p…