-
### System Info
```Shell
accelerate==0.18.0
system==M2 macos 13.3.1
```
### Information
- [ ] The official example scripts
- [X] My own modified scripts
### Tasks
- [ ] One of the…
-
## Description
Verify that we are able to fine-tune a model with multi-gpu sharding (fsdp) with bf16.
## Discussion
Provide detailed discussion here
## Acceptance Criteria
- [ ] Uni…
-
Steps to reproduce:
`test.py`
```
import mxnet as mx
shape = (4, 2)
def init_kv():
"""init kv """
kv = mx.kv.create('dist')
kv.init(3, mx.nd.ones(shape=shape))
return kv…
-
I was reading [`assign_mpz`](https://github.com/fplll/fpylll/blob/master/src/fpylll/io.pyx#L40-L60) and see that even if internally the IntegerMatrix uses mpz, it doesn't accept value passed in as typ…
-
Our use case - we want to run IP range queries in IPV6 addresses. In order to do that, we thought to convert the IPV6 string to multi-precision integer (which can be bigger than int64)
-
Fine-tuning:
- 4 models are working on Ollama (3 tinyLlama verisons with 1, 10, 50 epoch)
- I was able to train an Llama2 model (1 epoch only)
- Llama.cpp depricated some functionality which made …
-
### Describe the issue
A global list of updates that IntelliLex offers for autogen:
1. Autogen-conveyor is a fully automated tool that allows you to create a multi-level system for performing comp…
-
Hi, I tested multi-block-mode for TRT-LLM based on [Yi-6B](https://huggingface.co/01-ai/Yi-6B-Chat) model (llama-structure), the performance is as follows. It seems that
1. Multi-block-mode (MBM) w…
-
I can finetune a pretrained model using two nodes outside docker by several steps to get better precision. But when I do the same thing in the docker( without any error messages) by several steps in t…
-
# Task Name
Music Mood Classification
## Task Objective
Classifying the mood of a song or a piece of music could be very useful in exploring and suggesting a large collection of music.
## …