-
**Describe the bug**
cache[f"blocks.{x}.hook_resid_pre"] doesn't match hidden states (or only up to a set decimal place).
Hidden states is from transformer's model(tokens, output_hidden_states=Tru…
-
### Feature request
Add the GPTNeoX model in TensorFlow.
### Motivation
Having GPTNeoX in TensorFlow would benefit the community.
### Your contribution
@gante is it possible to assign this to me?…
-
[Blog Post Announcement](https://stability.ai/blog/stability-ai-launches-the-first-of-its-stablelm-suite-of-language-models)
(It may be using the same architecture as GPT-NeoX)
[![Launch In Colab]…
-
In order to complete the prototypes for OLID and DailyDialog, we need to implement adaptations for the operations `similar` and `rationalize`.
## OLID
- [x] similar
- [x] rationalize
## DailyD…
-
It would be useful in figuring out when to attribute changes to MLP layer vs. attention heads. Ideally would train seperate tuned lens for intermediate residual stream, but maybe still helpful if you …
-
I try to use the [script in this repo](https://github.com/TabbyML/tabby/blob/main/tabby/tools/converter/huggingface_gptneox_convert.py) to convert gptneox model from huggingface model file to fastertr…
-
Dear authors,
I am very excited about the release of this model! Do you plan to integrate the model into [Hugging Face transformers](https://github.com/huggingface/transformers)?
We already [suppo…
-
I'm trying to load llama-7b-4bit model.
```
git clone https://github.com/0cc4m/KoboldAI -b 4bit --recurse-submodules
more setup
cd repos
git clone https://github.com/0cc4m/GPTQ-for-LLaMa -b gpt…
-
Traceback (most recent call last):
File "aiserver.py", line 598, in
koboldai_vars = koboldai_settings.koboldai_vars(socketio)
File "/kaggle/tmp/KoboldAI/koboldai_settings.py", line 99, in …
-
**LocalAI version:**
I am on commit: **574fa67bdcafd618859fcda4d239f10f326182a6**
**Environment, CPU architecture, OS, and Version:**
I am on Windows and using WSL2 with Ubuntu 22.04:
…