Describe the bug
When running 03_Model_customization/01_fine-tuning-titan-lite.ipynb or 02_fine-tuning_llama2.ipynb, the fine-tuning job fails with the error:
Input data at fine-tuning-datasets/train/train-cnn-5K.jsonl must follow '{"prompt": "<input text>", "completion": "<output text>"}' format
I have looked at the downloaded CNN data files, and they appear to be in the correct prompt/completion format.
To Reproduce
Run the above notebooks
Browse the Amazon Bedrock console > Foundation Models > Custom Models > Jobs
Expected behavior
Expected behaviour is for the fine-tuning job to complete successfully.
Screenshots
Desktop (please complete the following information):
Describe the bug When running 03_Model_customization/01_fine-tuning-titan-lite.ipynb or 02_fine-tuning_llama2.ipynb, the fine-tuning job fails with the error:
Input data at fine-tuning-datasets/train/train-cnn-5K.jsonl must follow '{"prompt": "<input text>", "completion": "<output text>"}' formatI have looked at the downloaded CNN data files, and they appear to be in the correct prompt/completion format.
To Reproduce
Expected behavior Expected behaviour is for the fine-tuning job to complete successfully.
Screenshots
Desktop (please complete the following information):
! Additional context !
Sagemaker Studio Kernel: Data Science 3.0 Files_from_s3.zip
Instance used: ml.c5.2xlarge