Closed willmj closed 1 month ago
Thanks for making a pull request! ๐ One of the maintainers will review and advise on the next steps.
@willmj what you pasted seems strange
The comments say that the raise is only when data prep is not skipped
# If we aren't skipping data preparation, then a dataset_text_field
# or formatting_func must be provided.
But the code triggers when dataset_kwargs["skip_prepare_dataset"]
is truthful, which is a contradiction because it should mean to skip the data prep
@fabianlim misunderstood your original comment in #358, closing this PR
Description of the change
Setting trl to version 0.9.6 causes the following error:
This PR is to temporarily revert the changes in PR #326 until Fabian's qlora fix is in the latest version of trl
Related issue number
How to verify the PR
Was the PR tested