search

mindspore-lab / mindone

one for all, Optimal generator with No Exception
Apache License 2.0
328 stars 62 forks source link

timestep issue in svd #515

Open bilalmashooq opened 1 month ago

bilalmashooq commented 1 month ago

(venv) PS C:\Users\Students\PycharmProjects\pythonProject> python examples/svd/image_to_video.py --mode=1 --SVD.config=examples/svd/configs/svd.yaml --SVD.checkpoint=checkpoints/svd-d19a808f.ckpt --SVD.num_frames=5 --SVD.fps=15 --image=download.jpeg --SVD.decode_chunk_size=1 flash attention is available. Image size is not divisible by 64 (300x168). Resizing it to (256x128)! Initialized embedder #0: FrozenOpenCLIPImagePredictionEmbedder with 683800065 params. Trainable: False Initialized embedder #1: ConcatTimestepEmbedderND with 0 params. Trainable: False Initialized embedder #2: ConcatTimestepEmbedderND with 0 params. Trainable: False Initialized embedder #3: VideoPredictionEmbedderWithEncoder with 83653863 params. Trainable: False Initialized embedder #4: ConcatTimestepEmbedderND with 0 params. Trainable: False Loading model from C:\Users\Students\PycharmProjects\pythonProject\checkpoints/svd-d19a808f.ckpt INFO:main:Starting video generation, this may take a while... Traceback (most recent call last): File "examples/svd/image_to_video.py", line 202, in main(cfg) File "examples/svd/image_to_video.py", line 181, in main vid = pipeline(Tensor(image)) File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\nn\cell.py", line 705, in call raise err File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\nn\cell.py", line 701, in call output = self._run_construct(args, kwargs) File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\nn\cell.py", line 482, in _run_construct output = self.construct(cast_inputs, kwargs) File "examples/svd/image_to_video.py", line 135, in construct samples_x = self.model.decode_first_stage(samples_z) File "C:\Users\Students\PycharmProjects\pythonProject\examples/stable_diffusion_xl\gm\models\diffusion.py", line 139, in decode_first_stage out = self.first_stage_model.decode(z) File "C:\Users\Students\PycharmProjects\pythonProject\examples/stable_diffusion_xl\gm\models\autoencoder.py", line 100, in decode x = self.decoder(z, kwargs) File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\nn\cell.py", line 705, in call raise err File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\nn\cell.py", line 701, in call output = self._run_construct(args, kwargs) File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\nn\cell.py", line 482, in _run_construct output = self.construct(cast_inputs, kwargs) File "C:\Users\Students\PycharmProjects\pythonProject\examples/stable_diffusion_xl\gm\modules\diffusionmodules\model.py", line 509, in construct h = self.mid.block_1(h, temb, kwargs) File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\nn\cell.py", line 705, in call raise err File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\nn\cell.py", line 701, in call output = self._run_construct(args, kwargs) File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\nn\cell.py", line 482, in _run_construct output = self.construct(*cast_inputs, **kwargs) File "C:\Users\Students\PycharmProjects\pythonProject\examples\svd\modules\temporal_ae.py", line 69, in construct x_spat = x.reshape(-1, timesteps, c, h, w).swapaxes(1, 2) # (b t) c h w -> b c t h w File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\common\tensor.py", line 2043, in swapaxes return tensor_operator_registry.get('swapaxes')(self, axis0, axis1) File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\ops\function\array_func.py", line 7334, in swapaxes axis0, axis1 = _check_swapaxes_axis((axis0, axis1), input.ndim) return len(self.shape) File "C:\Users\Students\PycharmProjects\pythonProject\venv\lib\site-packages\mindspore\common_stub_tensor.py", line 85, in shape self.stub_shape = self.stub.get_shape() TypeError: For primitive[Reshape], the input[shape] must be one of ['int', 'tuple', 'list'] with all Int elements, but got (-1, None, 512, 16, 32)

I am unable to resolve this issue, can you tell me why this is happening, using mindspore with cpu