search

MyNiuuu / MOFA-Video

Official Pytorch implementation for MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model.
https://myniuuu.github.io/MOFA_Video
Other
358 stars 22 forks source link

Click "Add Trajectory" Error #1

Closed zdyshine closed 3 weeks ago

zdyshine commented 4 weeks ago

After upload image, click "Add Trajectory" get error: Traceback (most recent call last): File "C:\conda\envs\DiffSynthStudio\lib\site-packages\gradio\routes.py", line 488, in run_predict output = await app.get_blocks().process_api( File "C:\conda\envs\DiffSynthStudio\lib\site-packages\gradio\blocks.py", line 1431, in process_api result = await self.call_function( File "C:\.conda\envs\DiffSynthStudio\lib\site-packages\gradio\blocks.py", line 1103, in call_function prediction = await anyio.to_thread.run_sync( File "C:.conda\envs\DiffSynthStudio\lib\site-packages\anyio\to_thread.py", line 56, in run_sync return await get_async_backend().run_sync_in_worker_thread( File "C:.conda\envs\DiffSynthStudio\lib\site-packages\anyio_backends_asyncio.py", line 2144, in run_sync_in_worker_thread return await future File "C:.conda\envs\DiffSynthStudio\lib\site-packages\anyio_backends_asyncio.py", line 851, in run result = context.run(func, args) File "C:.conda\envs\DiffSynthStudio\lib\site-packages\gradio\utils.py", line 707, in wrapper response = f(args, **kwargs) File "e:\004-VideoGen\code\MOFA-Video-Traj\run_gradio.py", line 692, in add_drag tracking_points.constructor_args['value'].append([]) AttributeError: 'State' object has no attribute 'constructor_args'

Can you give some suggestions?

MyNiuuu commented 4 weeks ago

Hi, thanks for your interest in our project.

Did you tried to restart the gradio demo? I've encountered this problem in a very low frequency, but restarting the gradio demo usually resolves it. I will work on addressing this issue in future updates.

hben35096 commented 3 weeks ago

Me too image

Loading pipeline components...: 100%|████████████| 5/5 [00:00<00:00, 236.76it/s]
models loaded.
Running on local URL:  [http://0.0.0.0:80](http://0.0.0.0/)

To create a public link, set `share=True` in `launch()`.
You selected None at [228, 133] from image
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 456, in call_prediction
    output = await route_utils.call_process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1522, in process_api
    result = await self.call_function(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1144, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/utils.py", line 674, in wrapper
    response = f(*args, **kwargs)
  File "/root/autodl-tmp/MOFA-Video/MOFA-Video-Traj/run_gradio.py", line 749, in add_tracking_points
    tracking_points.constructor_args['value'][-1].append(evt.index)
AttributeError: 'list' object has no attribute 'constructor_args'
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 456, in call_prediction
    output = await route_utils.call_process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1522, in process_api
    result = await self.call_function(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1144, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/utils.py", line 674, in wrapper
    response = f(*args, **kwargs)
  File "/root/autodl-tmp/MOFA-Video/MOFA-Video-Traj/run_gradio.py", line 749, in add_tracking_points
    tracking_points.constructor_args['value'][-1].append(evt.index)
AttributeError: 'list' object has no attribute 'constructor_args'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 501, in process_events
    response = await self.call_prediction(awake_events, batch)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 465, in call_prediction
    raise Exception(str(error) if show_error else None) from error
Exception: None
hben35096 commented 3 weeks ago

And this one, doesn’t seem to be a brush? image

MyNiuuu commented 3 weeks ago

And this one, doesn’t seem to be a brush? image

Current version only supports creating masks by clicking multiple times on the image. You can enlarge the area covered by each click using the 'Motion Brush Radius' bar.

Once we complete the preparation and release of the other parts of the code, we will update the Gradio inference demo for more advanced interface and support. thank you for your interest!

MyNiuuu commented 3 weeks ago

Me too image

Loading pipeline components...: 100%|████████████| 5/5 [00:00<00:00, 236.76it/s]
models loaded.
Running on local URL:  [http://0.0.0.0:80](http://0.0.0.0/)

To create a public link, set `share=True` in `launch()`.
You selected None at [228, 133] from image
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 456, in call_prediction
    output = await route_utils.call_process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1522, in process_api
    result = await self.call_function(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1144, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/utils.py", line 674, in wrapper
    response = f(*args, **kwargs)
  File "/root/autodl-tmp/MOFA-Video/MOFA-Video-Traj/run_gradio.py", line 749, in add_tracking_points
    tracking_points.constructor_args['value'][-1].append(evt.index)
AttributeError: 'list' object has no attribute 'constructor_args'
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 456, in call_prediction
    output = await route_utils.call_process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1522, in process_api
    result = await self.call_function(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1144, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/utils.py", line 674, in wrapper
    response = f(*args, **kwargs)
  File "/root/autodl-tmp/MOFA-Video/MOFA-Video-Traj/run_gradio.py", line 749, in add_tracking_points
    tracking_points.constructor_args['value'][-1].append(evt.index)
AttributeError: 'list' object has no attribute 'constructor_args'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 501, in process_events
    response = await self.call_prediction(awake_events, batch)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 465, in call_prediction
    raise Exception(str(error) if show_error else None) from error
Exception: None

This is caused by clicking the "add trajectory" button more than once without clicking the image to add trajectories.

zdyshine commented 3 weeks ago

Me too image

Loading pipeline components...: 100%|████████████| 5/5 [00:00<00:00, 236.76it/s]
models loaded.
Running on local URL:  [http://0.0.0.0:80](http://0.0.0.0/)

To create a public link, set `share=True` in `launch()`.
You selected None at [228, 133] from image
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 456, in call_prediction
    output = await route_utils.call_process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1522, in process_api
    result = await self.call_function(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1144, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/utils.py", line 674, in wrapper
    response = f(*args, **kwargs)
  File "/root/autodl-tmp/MOFA-Video/MOFA-Video-Traj/run_gradio.py", line 749, in add_tracking_points
    tracking_points.constructor_args['value'][-1].append(evt.index)
AttributeError: 'list' object has no attribute 'constructor_args'
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 456, in call_prediction
    output = await route_utils.call_process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1522, in process_api
    result = await self.call_function(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1144, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/utils.py", line 674, in wrapper
    response = f(*args, **kwargs)
  File "/root/autodl-tmp/MOFA-Video/MOFA-Video-Traj/run_gradio.py", line 749, in add_tracking_points
    tracking_points.constructor_args['value'][-1].append(evt.index)
AttributeError: 'list' object has no attribute 'constructor_args'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 501, in process_events
    response = await self.call_prediction(awake_events, batch)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 465, in call_prediction
    raise Exception(str(error) if show_error else None) from error
Exception: None

This is caused by clicking the "add trajectory" button more than once without clicking the image to add trajectories.

I followed the steps provided, but it was never successful.

1717554214484
MyNiuuu commented 3 weeks ago

Me too image

Loading pipeline components...: 100%|████████████| 5/5 [00:00<00:00, 236.76it/s]
models loaded.
Running on local URL:  [http://0.0.0.0:80](http://0.0.0.0/)

To create a public link, set `share=True` in `launch()`.
You selected None at [228, 133] from image
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 456, in call_prediction
    output = await route_utils.call_process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1522, in process_api
    result = await self.call_function(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1144, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/utils.py", line 674, in wrapper
    response = f(*args, **kwargs)
  File "/root/autodl-tmp/MOFA-Video/MOFA-Video-Traj/run_gradio.py", line 749, in add_tracking_points
    tracking_points.constructor_args['value'][-1].append(evt.index)
AttributeError: 'list' object has no attribute 'constructor_args'
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 456, in call_prediction
    output = await route_utils.call_process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1522, in process_api
    result = await self.call_function(
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/blocks.py", line 1144, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/root/miniconda3/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/utils.py", line 674, in wrapper
    response = f(*args, **kwargs)
  File "/root/autodl-tmp/MOFA-Video/MOFA-Video-Traj/run_gradio.py", line 749, in add_tracking_points
    tracking_points.constructor_args['value'][-1].append(evt.index)
AttributeError: 'list' object has no attribute 'constructor_args'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 501, in process_events
    response = await self.call_prediction(awake_events, batch)
  File "/root/miniconda3/lib/python3.10/site-packages/gradio/queueing.py", line 465, in call_prediction
    raise Exception(str(error) if show_error else None) from error
Exception: None

This is caused by clicking the "add trajectory" button more than once without clicking the image to add trajectories.

I followed the steps provided, but it was never successful. 1717554214484

What is your Gradio version? This demo will cause errors in previous Gradio versions. I test the demo with Gradio version of gradio==4.5.0.

Also, can you provide the image you used so that I can reproduce the error on my machine?

zdyshine commented 3 weeks ago

gradio==4.5.0

Thanks, After install gradio==4.5.0, error solved.