Added code to load rombodawg/MegaCodeTraining112k (key: megacode) and nickrosh/Evol-Instruct-Code-80k-v1 (key: evol_instruct_code).
Also added an optional fill_min_length parameter to InstructionDataset class. If specified instructions are concatenate until the total string length of prompts and completions exceeds fill_min_length. Seed for random order can optionally be specified (default: 42).
Added code to load
rombodawg/MegaCodeTraining112k
(key: megacode) andnickrosh/Evol-Instruct-Code-80k-v1
(key: evol_instruct_code). Also added an optionalfill_min_length
parameter toInstructionDataset
class. If specified instructions are concatenate until the total string length of prompts and completions exceedsfill_min_length
. Seed for random order can optionally be specified (default: 42).Example:
==4.31.0