-
### Feature request
From my understanding of the current implementation, the modules_to_save wrappers are currently limited to copying only one specific layer of the model (reference: https://github.…
-
### Describe the feature
I want to continue pre-training llama 2 70b using my own data. My data is about 1b tokens. I have read [Fine-tuning Llama 2 70B using PyTorch FSDP ](https://huggingface.co/bl…
-
**Command: tune run lora_finetune_single_device --config llama3_1/8B_lora_single_device**
**Output**:
```
INFO:torchtune.utils._logging:Running LoRAFinetuneRecipeSingleDevice with resolved config:…
-
Thanks for your excellent work and code. I have some questions about the code.
1. when ``stacking == True`` and ``zero_padding == True``?
https://github.com/ATP-1010/FederatedLLM/blob/8efe72d1a7c7…
-
- This issue focuses on the technical courses we take about LLM, we'll put the paper part in
https://github.com/xp1632/DFKI_working_log/issues/70
---
1. **ChainForge** https://chainforge.ai/ …
-
### What:
**Removal based on feature matching** involves detecting and analyzing key features in images to identify and eliminate duplicates or overlapping images. This technique uses feature detec…
-
You will see the problem in the text below, this is with using gpt-4o and version 0.5 of agent zero, but have similar issues with other models
User message ('e' to leave):
> Write a college level …
-
Hi,
I'm interested in finding near-duplicate audio files. My dataset is about 3000 thousands short audio files, between 0.5 seconds to 5 seconds. Unlike Shazam, both the "target" audio (i.e. the song…
-
### Zoom: https://navercorp.zoom.us/j/92208940283
### 페이스북: https://www.facebook.com/weeklyaiarxivpage
### News
- Conference
- ICLR 2024
- Abs: 9.23 AoE (9.21에서 변경) , Full paper: 9.28…
-
Hi,
I'm interested in finding near-duplicate audio files. My dataset is about 3000 thousands short audio files, between 0.5 seconds to 5 seconds. Unlike Shazam, both the "target" audio (i.e. the song…