xiezipeng-ML
commented
1 year ago oneflow版的权重训练完成：
- 官方：8万样本训练15万stepsPPL指标2.2左右，看配置应该是采用了
Adam - libai：8万个样本训练6.38万个样本(
15949个iter)后PPL指标达到2.2652784387037257，与官方持平，训练完所有样本后（大约2万个iter）PPL指标达到1.9577795238848128，采用的是AdamW，大约耗时两小时，训练115949个iter后PPL指标达到1.3769186667879731 - libai：8万样本，采用
Adam训练7天后PPL指标在7.0稳定并且不再下降，有点疑惑。。。 - 我们的
where op存在问题，在libai训练配置下模型中使用where显示耗时大约16小时，注释后显示8小时, 之前和文骁发现有问题, @leaves-zwx
使用训练6.38万个样本的oneflow权重推理测试：
generated prompt: a dog jumping and and and an butterflies creature made of a steampunk detective marmotcthats and will porrared and and andic cinematic andinity on ei jinky gourge glcy covered wolf furaff logo of character design portrait of
generated prompt: a dog and and and a beautiful and wlady gilustration of a mage woman innocenthd cyber cowboy hat and and dan mumford, atal cat is handsome man in the golden children's wearing beautiful render, mirrors going - met motorcycle made
@CPFLAME
gpt2的generate以及pipeline，projects改名叫MagicPromptpipeline.py中增加了oneflow的diffuser的demoMagicPrompt是huggingface上的一个开源的gpt2的权重，这个权重在huggingface上的下载达到30.8k：Gustavosta/MagicPrompt-Stable-Diffusion，这个权重的功能是给stable-diffusion生成prompt，例如例子中只需要输入“a dog”，gpt2的pipeline可以自动生成：a dog in a astronaut suit and luffy, intricate, luffy, highly detailed, digital painting, artstation, concept art, smooth, sharp focus, illustration, luffy, unreal engine 5, 8 k, art by artgerm，gpt2（magicprompt）这里是这个
demo出来的图片： prompt：a dog, baroque painting, beautiful detailed intricate insanely detailed octane render trending on artstation, 8 k artistic photography, photorealistic, soft natural volumetric cinematic perfect light, chiaroscuro, award - winning photograph