请问能不能测试下GPT-4的 L_{test} - L_{train}

SkyworkAI / Skywork

Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。

Other

1.22k stars 111 forks source link

请问能不能测试下GPT-4的 L_{test} - L_{train} #31

Closed wxj630 closed 12 months ago

wxj630 commented 12 months ago

L{test} - L{train}，想知道GPT-4是不是也见过了训练集，所以严格来说GPT-4也不能完全说是zero-shot ?

zhao1iang commented 12 months ago

L{test} - L{train}需要获取模型logits计算loss，但目前GPT-4只输出答案并不能输出logits。

wxj630 commented 12 months ago

ok谢谢解答