-
[https://huggingface.co/docs/peft/v0.12.0/index](url)
[https://github.com/huggingface/peft](url)
If i understood correctly with this tech is possible to train sdxl Lora on low mem gpu, I do not kn…
-
- Llama : https://llama.meta.com/docs/how-to-guides/fine-tuning
- Quantization : 실수형 변수(float)를 정수형 변수(int)로 변환
- 효과
- 모델 사이즈 축소
- 모델 연산량 감소
- 효율적인 하드웨어 사용
- Parameter Efficient Fi…
-
https://github.com/Arnav0400/ViT-Slim/tree/master/GLoRA
_Since I don't have the technical knowledge to know how meaningful or relevant this is for lora in SD I'm posting it here to bring attention …
-
Layer-Condensed KV Cache for Efficient Inference of Large Language Models
https://arxiv.org/abs/2405.10637
Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet
https://tr…
-
Dear repository owner,
I am reaching out to express our admiration for your repository.
I am the author who recently published a paper titled "Learning Semantic Proxies from Visual Prompts for P…
-
If am not wrong the proposed adapter contains 183M parameters when you compare this with the VIT-B encoder which is composed of 63M params approximately. How can you claim that your adapter is efficie…
-
Snowflake Arctic
https://www.snowflake.com/blog/arctic-open-efficient-foundation-language-models-snowflake/
https://huggingface.co/Snowflake/snowflake-arctic-instruct
ExecuTorch
https://pytorch.…
-
### 🚀 The feature, motivation and pitch
Fuyou Training Framework Integration for PyTorch
Description:
Integrate the Fuyou training framework into PyTorch to enable efficient fine-tuning of larg…
-
- [ ] [LoRA Land: Fine-Tuned Open-Source LLMs that Outperform GPT-4 - Predibase - Predibase](https://predibase.com/blog/lora-land-fine-tuned-open-source-llms-that-outperform-gpt-4)
# LoRA Land: Fine…
-
To enable efficient training on GPUs and scale our repository for models with millions to billions of parameters—essential for working with large visual language models—we must implement optimization …