-
## Proposal
### Introduction
OS Assistant is an integrated assistant powered by LLM to OpenSearch users that a user can interact with through chat, from integrated OpenSearch Dashboard pages, or …
-
cmake is not successful
```
❯ cmake --version
cmake version 3.21.0
CMake suite maintained and supported by Kitware (kitware.com/cmake).
```
```
mkdir build
cd build
cmake -DCMAKE_INSTA…
-
Hello, I'm using 24.03-trtllm-python-py3 with image size 8.38 GB which is not small but ok.
I'm going to migrate to the newest versions like 24.04 or 24.05 but it size drastically increased to 18.46 …
Prots updated
1 month ago
-
### Community Note
* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the…
-
### What is the issue?
After running for a while, the model still returns gibberish:
```
[12:59:39] [INFO] [Part of Speech Determination] [Fixed] JSON string: Since you did not provide specific con…
-
**Describe the bug**
When I run `ilab data generate` there is no update or output like 0.17.1.
```
(venv-instructlab-3.11) ➜ instructlab ilab data generate
INFO 2024-08-08 16:00:04,437 numexpr.utils…
-
Concise Description:
I'd like to use JAX for distributed training of LLMs. In addition, the new release of Keras supports JAX as a backend in addition to TF.
Describe the solution you'd like
I'd …
-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### W…
-
Hi FlexFlow team,
I used the methods mentioned in #1099 to test the latency(GPU: RTX-4090), but i get a confused result:
1)LLaMA-7B + 1个SSM(llama-160M), latency: 25.1 s
2)LLaMA-7B(without ssms), la…
-
[LMDeploy](https://github.com/InternLM/lmdeploy/tree/main) is a toolkit for compressing, deploying, and serving LLMs.
It also supports llama and llama-2.
Wondering if it could be the fastest serve…