-
### Your current environment
```text
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.3 LTS (x86_64)
GCC ve…
-
### Bug description
Hi there 👋
First thanks for this awesome library you guys built!
I just have what I believe is a bug when using the `litgpt pretrain` command when you want to set a fixed…
-
hi, can I knew the exact syntax, mine is still error:
```python
model = dict(
freeze_llm=True,
freeze_visual_encoder=True,
llm=dict(
attn_implementation='eager',
p…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
### Bug Report
There was a noticeable slowdown of doing inference on LLMs. Something like 30-40% less tokens / second.
This change affected both CPU, Cuda and Vulkan backends.
This regression…
-
### Describe the issue as clearly as possible:
Not sure if this is a bug or a feature request. But `accelerate` apparently isn't installed in the docker image. Which means that one can either use tra…
-
# Model presets
LeapfrogAI currently has two primary models that are used on the backend, but more should be added/tested. By implementing certain small models and evaluating their efficacy from a hu…
-
Whenever I try to load it, it crashes Chrome.
This is on a Pixel 6a with 6Gb of RAM.
- Context is set to 1K.
- 16 bit WebGPU is available.
- Using latest version of WebLLM from CDN.
To make…
-
**Steps to Reproduce:**
1. Run `curl -sSfL 'https://github.com/GaiaNet-AI/gaianet-node/releases/latest/download/install.sh' | bash`
2. Run `source /root/.bashrc`
3. Run `/root/gaianet/bin/gaianet i…
-
After compiling the example Android app for Phi-3 I've downloaded the model file from hugging face seperately and placed it in /data/data/.../files, however when trying to run the app always crashes i…