Improve Instruction Fine-Tuning Documentation on AWS Jumpstart

aws / amazon-sagemaker-feedback

Amazon SageMaker Public Feedback Dashboard

Creative Commons Attribution Share Alike 4.0 International

4 stars 1 forks source link

Improve Instruction Fine-Tuning Documentation on AWS Jumpstart #98

Open erikinfo opened 3 weeks ago

erikinfo commented 3 weeks ago

Product Category

JumpStart

Feedback Category

Clarity and Comprehensibility, Missing Examples and Tutorials

Reference Link

No response

Details

It would be beneficial to clearly state if pre-processing of samples is necessary (any special tokens that need to be inserted for Mixtral 8x7b) / how the expected samples should look like. Also, the layout is messed up.

erikinfo commented 3 weeks ago

This leads to: ValueError: Part or all of input keys in the prompt template are found missing in the column names of each example.Input keys are ['instruction', 'context', 'response'], while column names are ['prompt', 'completion'].

This was not mentioned in the documentation.