search

unionai / unionai-examples

A collection of example workflows that run on Union
https://www.union.ai/
7 stars 2 forks source link

video translator #66

Open wangpei7001 opened 5 days ago

wangpei7001 commented 5 days ago

Thanks for the great project, I got the following error when running the video translator locally:

`

tts_models/multilingual/multi-dataset/xtts_v2 is already downloaded. Using model: xtts Text splitted to sentences. ['Eine meiner größten Schwächen ist, um Hilfe zu bitten, wenn ich sie brauche.', 'Ich würde das gerne besser machen.'] Processing time: 16.305320024490356 Real-time factor: 1.2662441766454846 11:41:08.189145 ERROR base_task.py:730 - Failed to convert inputs of task 'video_translation.lip_sync':
USER:AssertionError: error=Cannot convert from Flyte Serialized object (Literal):
scalar:
blob:
metadata:
uri: [...] to <class 'flytekit.types.file.file.FlyteFile'>. Expected a file, but
/var/folders/hw/b9wt5xr90gnd39nt99ckwg0c0000gn/T/flyte9qril_vy/user_space3t42q_2q/__cp is not a file. `

kumare3 commented 5 days ago

cc @samhita-alla for the issue

samhita-alla commented 5 days ago

@wangpei7001 there are four files expected by the lip sync task: https://github.com/unionai/unionai-examples/blob/a873fc2ed87b05bcc0f52811c51367fbc4c746d9/tutorials/video_translation/video_translation.py#L252-L255 which one of these is causing the error?

wangpei7001 commented 5 days ago

not sure which file, I am checking the code, here is the traceback of error:

Screenshot 2024-10-04 at 16 17 11
samhita-alla commented 2 days ago

could you share your workflow here?