-
## Overview
The research team that developed InstructLab's processes has determined that we need a way to mix generated datasets before training. This is necessary to get the best results we can wh…
-
- [ ] Num_instructions/sdg_scale_factor currently is setup only for the freeform skills - we need some logic to split that value between contexts and grounded questions for grounded skills. https://gi…
-
In Training_a_LoRA_With_Instruct_Lab.ipynb, while converting LORA to gguf, all the required files are not getting downloaded and thus in the next cell "!python convert-lora-to-ggml.py ../adapter-only"…
-
Rather than raising an error when batch sizes are set too small for multipack sampling (max_seq_length > packing_max_batch_len), we should be able to switch back to naive sampling for those cases, sim…
-
See #142 and https://github.com/instructlab/sdg/pull/163#discussion_r1684206468 and https://github.com/instructlab/sdg/pull/182#discussion_r1688345839
Anywhere we do this conversion, we need to:
…
-
**Is your feature request related to a problem? Please describe.**
Multi-phase training can fail for a number of reasons:
1. Run out of disk space unexpectedly
2. Machine loses power / unexpected main…
-
After the merge of https://github.com/instructlab/instructlab/pull/1471, we observed that several unit tests were inadvertently removed. It appears that this was overlooked during the review process.
…
leseb updated
2 months ago
-
# Motivation
We allocated four hosts for RHELAI testing in https://github.com/nerc-project/operations/issues/595. We weren't able to use ESI at the time because of some issues around UEFI booting. Th…
-
**Describe the bug**
I was following the steps on gpu-acceleration.md and, when executing [this line](https://github.com/instructlab/instructlab/blob/main/docs/gpu-acceleration.md#:~:text=cache%2…
-
It would be nice to implement a way to auto-detect hardware, and suggest an appropriate default config profile for each of the components based on the hardware we detect. This will make for a smoother…
ktam3 updated
1 month ago