-
You and I mentioned this subject in Issue #9 : "draw simple (winning) endgame" ?
> [tissatussa commented]
> i gathered many engines, also NN, but honestly i don't know the real strength and advant…
-
I am noticing a trend that has happened to my friend, and I, as we use CosinewithAnnealingLR and Prodigy, but it doesn't begin to really learn until it is almost done. I am wondering what is going on…
-
[How To Create Your Own LLM-Powered Slackbot With Langchain on Your Own Private Data](https://pub.towardsai.net/how-to-create-your-own-llm-powered-slackbot-with-langchain-on-your-own-private-data-f435…
-
I am just a little confused when reading the paper.
"Technically, we choose to fine-tune the pre-trained SAMusing a parameter-efficient fine-tuning (PEFT) technique called Adaption [18]"
The Ad…
-
Installation commands:
```
conda create -n llama_etuning python=3.10
conda activate llama_etuning
cd LLaMA-Efficient-Tuning
pip install -r requirements.txt
pip install protobuf
```
Run command…
-
I've got a bunch of compute the next couple weeks and thinking to train this on LAION.
Wondering if there is any other training going on right now. Would hate to duplicate efforts too much.
-
06/08/2023 07:52:29 - INFO - utils.common - Loading dataset train_rlhf_100000_format.json...
06/08/2023 07:52:29 - WARNING - utils.common - Checksum failed: missing SHA-1 hash value in dataset_info.j…
-
hi,作者,我有一个问题需要咨询一下。谢谢。
使用api_demo.py ,启动合并后的模型跟checkpoint_dir,启动时失败。下面是错误信息:
Some weights of the model checkpoint at /data/project/ChatGLM-Efficient-Tuning/path_to_export were not used when initiali…
-
Just an FYI. Kohya_ss has started to integrate code for SDXL training support in his sdxl branch. He must apparently already have access to the model cause some of the code and README details make it …
-
I'm trying to use Parameter-Efficient Fine-tuning approaches for a `SEQ_2_SEQ_LM` tasks (`ought/raft`: `twitter_complaints`, `tweet_eval_hate`). I'm mainly testing with models such as `google/flan-t5-…