hey there i managed to get it installed on vast.ai with 4xH100 when i run the gradio_ui.py i get this error:
2024-10-25 06:12:38,514 WARNING worker.py:1481 -- SIGTERM handler is not set because current thread is not the main thread.
Traceback (most recent call last):
File "/workspace/models/.venv/lib/python3.10/site-packages/gradio/routes.py", line 439, in run_predict
output = await app.get_blocks().process_api(
File "/workspace/models/.venv/lib/python3.10/site-packages/gradio/blocks.py", line 1384, in process_api
result = await self.call_function(
File "/workspace/models/.venv/lib/python3.10/site-packages/gradio/blocks.py", line 1089, in call_function
prediction = await anyio.to_thread.run_sync(
File "/workspace/models/.venv/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
File "/workspace/models/.venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2441, in run_sync_in_worker_thread
return await future
File "/workspace/models/.venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 943, in run
result = context.run(func, *args)
File "/workspace/models/.venv/lib/python3.10/site-packages/gradio/utils.py", line 700, in wrapper
response = f(*args, **kwargs)
File "/workspace/models/src/mochi_preview/infer.py", line 73, in generate_video
load_model()
File "/workspace/models/src/mochi_preview/infer.py", line 28, in load_model
ray.init()
File "/workspace/models/.venv/lib/python3.10/site-packages/ray/_private/client_mode_hook.py", line 103, in wrapper
return func(*args, **kwargs)
File "/workspace/models/.venv/lib/python3.10/site-packages/ray/_private/worker.py", line 1653, in init
raise RuntimeError(
RuntimeError: Maybe you called ray.init twice by accident? This error can be suppressed by passing in 'ignore_reinit_error=True' or by calling 'ray.shutdown()' prior to 'ray.init()'.
it would also be good if you ad demo.launch() demo.launch(share=True) as i guess not that many people have 4xH100 laying around at home hehe :D was sooo close to my first generation damn :D
hey there i managed to get it installed on vast.ai with 4xH100 when i run the gradio_ui.py i get this error:
it would also be good if you ad demo.launch() demo.launch(share=True) as i guess not that many people have 4xH100 laying around at home hehe :D was sooo close to my first generation damn :D
cheers and thx janosch