Open lllAlexanderlll opened 10 months ago
The tasks
lambada_openai,lambada_openai_cloze,lambada_openai_mt_de,lambada_openai_mt_en,lambada_openai_mt_es,lambada_openai_mt_fr,lambada_openai_mt_it
result in zero or near zero scores with the HF-converted 7B-EQ model, while the Megatron checkpoint reaches valid scores of 33% to 53%.
The tasks
result in zero or near zero scores with the HF-converted 7B-EQ model, while the Megatron checkpoint reaches valid scores of 33% to 53%.