-
Could you please add fine-tuning support for gemma-2 ? It has good good multilingual capabilities and is a good candidate for fine-tuning for languages other than English.
Its different sizes also m…
-
像是缺失了文件
Unrecognized model in D:\LIUGEGE\ComfyUI\models\Joy_caption_alpha\text_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, a…
-
Is it possible to add out of the box functionality with OS models like llama 405b?
-
Are there any plans to support Gemma2 in the torchtitan? I tried to use torchtitan to finetune Gemma2 model, but stuck on the following problem: how to parallelize tied layer in Gemma2 model? Maybe so…
-
## タイトル: ShieldGemma:Gemmaに基づく生成AIコンテンツモデレーション
## リンク: https://arxiv.org/abs/2407.21772
## 概要:
Gemma2を基盤としたLLMベースの安全コンテンツモデレーションモデル群「ShieldGemma」を紹介します。これらのモデルは、ユーザー入力とLLM生成出力の両方において、主要な有害タイプ(性的描写…
-
I've tried using llamacpp in both docker and native versions using the provided guides:
https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/llama_cpp_quickstart.md
https://g…
-
### What is the issue?
Load any model, for example gemma2:27b
OLLAMA_KEEP_ALIVE: -1
command: **ollama run gemma2:27b --verbose**
message: **tell me about amd**
**1 iteration**
total duration…
-
Just installed this to try it out...well
Seems it goes to some kind of loop or repeating mode.
Tried to use it with server and client and run local. Both results are the same:
```
/speech-to-s…
-
I am using AutoModelForSequenceClassification for classifying a large model. Can I use this library, and how should I use it?
Additionally, if my output is only one token and I do batch inference, w…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue y…