search

epfLLM / Megatron-LLM

distributed trainer for LLMs
Other
504 stars 73 forks source link

Error in document (https://epfllm.github.io/Megatron-LLM/guide/instruction_tuning.html#data-preprocessing) #102

Open yushengsu-thu opened 4 months ago

yushengsu-thu commented 4 months ago

Refer to : https://epfllm.github.io/Megatron-LLM/guide/instruction_tuning.html#data-preprocessing

The preprocess_instruct_data.py should be under tool instead of instruct; thus, the script should be:

python tool/preprocess_instruct_data.py \