-
## env
```
composer: 0.23.4
llm-foundary: v0.9.0
```
## example config with lora
```
.... # mpt-7b-arc-easy--gpu.yaml
peft_config:
r: 64
peft_type: LORA
task_type: CAUSAL_LM…
-
**I tried the tutorial twice and failed. The conversion process worked fine, but every time I ran it, I got the same bug, a RuntimeError, as follows:**
```
{
NSLocalizedDescription = "at /private/v…
-
## 🚀 Feature
This issue is meant to roll up the conversation for how PyTorch intends to extend complex number support to nn module.
## Motivation
Complex Neural Networks are quickly becoming an…
-
Hi,
we could sucessfully pretrain various MosaicBERT models and evaluations with composer-based fine-tuning look really good :)
However, when using a/the conversion script `llm-foundry/scripts/i…
-
- We have executed the LLaMA model (downloaded from HuggingFace[https://huggingface.co/meta-llama/Llama-2-7b-chat-hf]) using the NNTrainer and obtained the following output by following these steps…
-
### Checklist
- [X] The issue exists after disabling all extensions
- [ ] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
-
I train the model successfully, but can't convert it to tflife, souce not support.
@WongKinYiu thanks you so much
-
Hi @DingXiaoH :
thanks to your great masterpiece .
and as i wanna check the finished_converted.hdf5 that if the acc has dropped after folding conv and fusing bn ? so i need to load fin…
-
I am running the notebook YOLO example of TLT Version 2 release in the tlt docker. I have successfully trained, pruned, and retrained the YOLO-restnet18. The results of FP32’s are fine but when I exec…
-
Hi,
Is it possible to convert a [LoRA](https://github.com/ml-explore/mlx-examples/tree/main/lora) model trained with MLX back into the HuggingFace format to publish on the HuggingFace hub, and prefer…