Open tiendung opened 1 year ago
Thank you @tiendung
Yes! Very much on the radar, in fact the "sparsification" mention in the README was added initially with sparsegpt in mind.
Let's keep this open and get it done in the next few days. BTW would you be interested in contributing this one?
I would like to contribute to this wonderful project. pre-training a new model is my most interest right now. I think I'll try to contribute to train.py first, a better sampling strategy for big dataset (100G of text for example)? I need to understand the training code first :)
Hi,
I have offline support for Llama models and SparseGPT - wondering what is the right way to get started with the integration into this repository ?
Sparse should reduce the size and increase infer speed without hurting perf too much. This repo https://github.com/IST-DASLab/sparsegpt is Apache license and may be useful (I hope)