v.1.1 inferece invalid video?

PKU-YuanGroup / Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Apache License 2.0

10.87k stars 971 forks source link

v.1.1 inferece invalid video? #292

Open lbwang2006 opened 1 month ago

lbwang2006 commented 1 month ago

first I need to modify T5 dtype
" text_encoder = T5EncoderModel.from_pretrained(args.text_encoder_name, cache_dir=args.cache_dir).to(device,torch.float16)"

then the generated video is invalid,what is wrong......