-
# Overview
relaion-2b-en-research-safeのgemmaによる翻訳
# Details
マルチモーダルWGにおいて, CLIPのデータ整備のために, ReLAION-5Bのcaptionをgemma-2-9b-it で日本語に翻訳
# Resources
* **計算機**
* クラスタ: llm-jp-nvlink
* ノ…
-
Hello, I've been asking a lot of questions today. After building the Android phone app I created as an example and installing it on a Galaxy S22 model with 12GB of memory, I found that only the Llama …
-
### Bug description
The Pytorch Lightining is taking more memory than Pytorch FSDP.
I'm able to train the gemma-2b model but it takes 3 times more memory.
For openchat it goes out of memory.
…
-
iOS 16.0
iPhone 12
I have a q4 gguf, but everytime I try to start, it crashes.
-
Hello,
In running chat ui and trying some models, with phi3 and llama i had no problem but when I run gemma2 in vllm Im not able to make any good api request,
in env.local:
{
"name": "google/g…
-
## Describe the bug
Have a look :-)
https://github.com/user-attachments/assets/321dbb21-2403-4330-9ce1-091902298888
## Latest commit or version
0.22
MBP M3 Max
-
I have a problem with API communications in new LM Studio 0.3.2, everything was fine before the @lmstudio/sdk version 0.0.12 update to 0.1.0 for new version of LM Studio. Now I have an ERROR 2024-09-0…
-
### Your current environment
```text
PyTorch version: 2.1.2+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Debian GNU/Linux 11 (bullseye) (x…
-
### Description
Using gemma-2-2b-it-GGUF (e.g. bartowski/gemma-2-2b-it-GGUF, Q6_K) in the InstructModeExecute example, the following fatal error occurs and the process dies:
`D:\a\LLamaSharp\LLamaSh…
-
When making AI requests to Aphrodite strange responses are returned.
Example:
Input: test test test
Output:
[Test Input.txt](https://github.com/user-attachments/files/17190780/Test.Input.txt)
…