search

rmihaylov / mpttune

Tune MPTs
Apache License 2.0
84 stars 17 forks source link

output, instruction, input have been ignored #12

Closed Einengutenmorgen closed 1 year ago

Einengutenmorgen commented 1 year ago

Im training the MPT-7B-STORYWRITER-4BIT-128G with the alpaca_data_cleaned.json and the example setup. The training runs smoothly, but I get this warning:

The following columns in the training set don't have a corresponding argument in PeftModelForCausalLM.forward and have been ignored: output, instruction, input. If output, instruction, input are not expected by PeftModelForCausalLM.forward, you can safely ignore this message.

Im not sure what effect it had on my results and I can't find the part of the code that produces this warning.

Where can I find this part of the code ? Somebody else had this warning ?

Einengutenmorgen commented 1 year ago

a waring that could be ignored