search

Ikaros-521 / digital_human_video_player

带HTTP API的数字人视频播放器，使用gradio api对接Easy-Wav2Lip、Sadtalker、GeneFacePlusPlus、MuseTalk，也可以用于播放本地视频
https://www.bilibili.com/video/BV1iW421P7si
GNU General Public License v3.0
85 stars 22 forks source link

INFO: digital_human_video_player发送成功，返回：操作失败: 'type' #2

Closed Night42 closed 3 months ago

Night42 commented 3 months ago

AI-Vtuber-20240312日志：

2024-04-03 14:11:43 - D:\AI-Vtuber-20240312\webui.py[line:249] - INFO: 程序开始 运行
pygame 2.5.0 (SDL 2.28.0, Python 3.10.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\my_handle.py[line:75] - INFO: 初始化My_handle...
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\audio.py[line:1095] - INFO: 文案播放线程运行中...
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\audio.py[line:204] - INFO: 创 建音频合成消息队列线程
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\audio.py[line:1185] - INFO: 重载所有文案数据
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\gpt_model\claude.py[line:28] - INFO: Claude slack_user_token or bot_user_id 为空，不进行实例化.
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\gpt_model\gpt.py[line:69] - INFO: GPT_MODEL: 进入get方法
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\my_handle.py[line:219] - INFO: ./log/log-2024-4-3.txt 日志文件已存在，跳过
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\my_handle.py[line:228] - INFO: ./log/comment-2024-4-3.txt 弹幕文件已存在，跳过
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\my_handle.py[line:264] - INFO: 创建数据库:data/data.db
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\utils\my_handle.py[line:143] - INFO: 配置数据加载成功。
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\main.py[line:490] - INFO: 单击键盘 Q 按键进行录音喵~ 由于其他任务还要启动，如果按键没有反应，请等待一段时间
2024-04-03 14:11:48 - D:\AI-Vtuber-20240312\main.py[line:782] - INFO: 当前平台：talk
 * Serving Flask app 'main'
 * Debug mode: off
2024-04-03 14:12:00 - D:\AI-Vtuber-20240312\main.py[line:104] - INFO: API收到数 据：{'type': 'comment', 'platform': 'webui', 'username': '午夜', 'content': '你 好'}
2024-04-03 14:12:01 - D:\AI-Vtuber-20240312\Miniconda3\lib\site-packages\langid\langid.py[line:162] - INFO: initializing identifier
2024-04-03 14:12:05 - D:\AI-Vtuber-20240312\utils\gpt_model\chatgpt.py[line:65] - INFO: 会话ID: {'msg': [{'role': 'system', 'content': '请扮演一个AI虚拟主播。不要回答任何敏感问题！不要强调你是主播，只需要回答问题！'}, {'role': 'system', 'content': 'current time is:2024-04-03 14:12:02'}], 'id': '午夜'}
2024-04-03 14:12:05 - D:\AI-Vtuber-20240312\utils\my_handle.py[line:1858] - INFO: [AI回复午夜]：你好！有什么我可以帮助您的吗？
2024-04-03 14:12:08 - D:\AI-Vtuber-20240312\utils\audio.py[line:883] - INFO: edge-tts合成成功，合成内容：【午夜说:你好】，输出到=D:\AI-Vtuber-20240312\out\edge_tts_2.mp3
2024-04-03 14:12:08 - D:\AI-Vtuber-20240312\utils\common.py[line:736] - INFO: 写入文件:log/字幕.txt，内容：【午夜说:你好】
2024-04-03 14:12:12 - D:\AI-Vtuber-20240312\utils\audio.py[line:362] - INFO: digital_human_video_player发送成功，返回：操作失败: 'type'
2024-04-03 14:12:14 - D:\AI-Vtuber-20240312\utils\audio.py[line:883] - INFO: edge-tts合成成功，合成内容：【你好！有什么我可以帮助您的吗？】，输出到=D:\AI-Vtuber-20240312\out\edge_tts_3.mp3
2024-04-03 14:12:14 - D:\AI-Vtuber-20240312\utils\common.py[line:736] - INFO: 写入文件:log/字幕.txt，内容：【你好！有什么我可以帮助您的吗？】
2024-04-03 14:12:15 - D:\AI-Vtuber-20240312\utils\audio.py[line:362] - INFO: digital_human_video_player发送成功，返回：操作失败: 'type'

digital_human_video_player-v0.1.2日志：

[2024-04-03 14:11:28 +0800] [14252] [INFO] Running on http://127.0.0.1:8091 (CTRL + C to quit)
2024-04-03 14:11:28 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\hypercorn\logging.py[line:106] - INFO: Running on http://127.0.0.1:8091 (CTRL + C to quit)

DevTools listening on ws://127.0.0.1:11252/devtools/browser/6c99f9c1-2974-48d7-82b4-4fcde6da0fb5
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11259 GET / 1.1 302 223 1545
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11259 GET / 1.1 - - 1545
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11259 GET /static/index.html 1.1 200 3815 73821
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11259 GET /static/index.html 1.1 - - 74821
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11259 GET /static/videos/1.mp4 1.1 - - 7999
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11260 GET /static/videos/1.mp4 1.1 206 7140 2999
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11260 GET /static/videos/1.mp4 1.1 - - 4000
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11262 GET /favicon.ico 1.1 404 207 997
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11262 GET /favicon.ico 1.1 - - 2007
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11263 GET /favicon.ico 1.1 404 207 1000
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11263 GET /favicon.ico 1.1 - - 1000
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11260 GET /static/videos/1.mp4 1.1 - - 185998
[2024-04-03 14:11:33 +0800] [14252] [INFO] 127.0.0.1:11265 GET /ws 1.1 101 - 1000
2024-04-03 14:12:09 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'audio_path': 'D:\\AI-Vtuber-20240312\\out\\edge_tts_2.mp3', 'insert_index': -1}
[2024-04-03 14:12:12 +0800] [14252] [INFO] 127.0.0.1:11347 POST /show 1.1 200 57 3416344
[2024-04-03 14:12:12 +0800] [14252] [INFO] 127.0.0.1:11347 POST /show 1.1 - - 3418345
2024-04-03 14:12:15 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'audio_path': 'D:\\AI-Vtuber-20240312\\out\\edge_tts_3.mp3', 'insert_index': -1}
[2024-04-03 14:12:15 +0800] [14252] [INFO] 127.0.0.1:11351 POST /show 1.1 200 57 1001
[2024-04-03 14:12:15 +0800] [14252] [INFO] 127.0.0.1:11351 POST /show 1.1 - - 2001

Easy-Wav2Lip-眠-0229日志：

Active code page: 65001
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Ikaros-521 commented 3 months ago

感觉是sadtalker合成失败了。

Ikaros-521 commented 3 months ago

不过播放器居然没报错

Night42 commented 3 months ago

感觉是sadtalker合成失败了。

大佬，我又更新了一下AI-Vtuber版本至AI-Vtuber-20240326，Easy-Wav2Lip-眠-0229有反应了，但还是报错

AI-Vtuber-20240326日志：

pygame 2.5.0 (SDL 2.28.0, Python 3.10.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
2024-04-04 21:27:20 - D:\AI-Vtuber-20240326\utils\audio.py[line:75] - INFO: 文案模式的Audio初始化...
2024-04-04 21:27:20 - D:\AI-Vtuber-20240326\webui.py[line:3985] - INFO: 本地Live2D模型名列表：['chitose', 'Haru', 'haru2', 'haruto', 'hibiki', 'Hiyori', 'koharu', 'Mao', 'miara_pro_en', 'Natori', 'nito', 'sizuku', 'tororo', 'tsumiki']
NiceGUI ready to go on http://localhost:8081
2024-04-04 21:30:41 - D:\AI-Vtuber-20240326\utils\common.py[line:775] - INFO: 写入文件:Live2D/js/model_name.js，内容：【var model_name = "Hiyori";】
2024-04-04 21:30:41 - D:\AI-Vtuber-20240326\webui.py[line:2190] - INFO: 配置数据已成功写入文件！
2024-04-04 21:31:12 - D:\AI-Vtuber-20240326\webui.py[line:253] - INFO: 运行程序: main
2024-04-04 21:31:12 - D:\AI-Vtuber-20240326\webui.py[line:328] - INFO: 程序开始 运行
pygame 2.5.0 (SDL 2.28.0, Python 3.10.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:75] - INFO: 初始化My_handle...
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:1099] - INFO: 文案播放线程运行中...
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:204] - INFO: 创 建音频合成消息队列线程
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:1189] - INFO: 重载所有文案数据
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\gpt_model\claude.py[line:28] - INFO: Claude slack_user_token or bot_user_id 为空，不进行实例化.
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\gpt_model\gpt.py[line:77] - INFO: GPT_MODEL: 进入get方法
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:225] - INFO: ./log/log-2024-4-4.txt 日志文件已存在，跳过
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:234] - INFO: ./log/comment-2024-4-4.txt 弹幕文件已存在，跳过
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:270] - INFO: 创建数据库:data/data.db
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:146] - INFO: 配置数据加载成功。
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\main.py[line:963] - INFO: 当前平台：talk
 * Serving Flask app 'main'
 * Debug mode: off
2024-04-04 21:31:36 - D:\AI-Vtuber-20240326\main.py[line:104] - INFO: API收到数 据：{'type': 'comment', 'platform': 'webui', 'username': '午夜', 'content': '你 好'}
2024-04-04 21:31:42 - D:\AI-Vtuber-20240326\webui.py[line:615] - INFO: callback 接口 收到数据：{'type': 'llm', 'data': {'type': '弹幕信息', 'username': '午夜', 'user_face': 'https://robohash.org/ui', 'content_type': 'question', 'content': '你好', 'timestamp': '2024-04-04 21:31:42'}}
2024-04-04 21:31:42 - D:\AI-Vtuber-20240326\Miniconda3\lib\site-packages\langid\langid.py[line:162] - INFO: initializing identifier
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\utils\gpt_model\chatgpt.py[line:65] - INFO: 会话ID: {'msg': [{'role': 'system', 'content': '请扮演一个AI虚拟主播。不要回答任何敏感问题！不要强调你是主播，只需要回答问题！'}, {'role': 'system', 'content': 'current time is:2024-04-04 21:31:43'}], 'id': '午夜'}
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\webui.py[line:615] - INFO: callback 接口 收到数据：{'type': 'llm', 'data': {'type': 'chatgpt', 'username': '午夜', 'content_type': 'answer', 'content': '你好！有什么我可以帮助你的吗？', 'timestamp': '2024-04-04 21:31:46'}}
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:2106] - INFO: [AI回复午夜]：你好！有什么我可以帮助你的吗？
2024-04-04 21:31:53 - D:\AI-Vtuber-20240326\utils\audio.py[line:886] - INFO: edge-tts合成成功，合成内容：【午夜说道:你好】，输出到=D:\AI-Vtuber-20240326\out\edge_tts_2.mp3
2024-04-04 21:31:54 - D:\AI-Vtuber-20240326\utils\audio.py[line:363] - INFO: digital_human_video_player发送成功，返回：视频合成失败
2024-04-04 21:32:00 - D:\AI-Vtuber-20240326\utils\audio.py[line:886] - INFO: edge-tts合成成功，合成内容：【你好！有什么我可以帮助你的吗？】，输出到=D:\AI-Vtuber-20240326\out\edge_tts_3.mp3
2024-04-04 21:32:01 - D:\AI-Vtuber-20240326\utils\audio.py[line:363] - INFO: digital_human_video_player发送成功，返回：视频合成失败

digital_human_video_player-v0.1.2日志：

[2024-04-04 21:21:14 +0800] [20200] [INFO] Running on http://127.0.0.1:8091 (CTRL + C to quit)
2024-04-04 21:21:14 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\hypercorn\logging.py[line:106] - INFO: Running on http://127.0.0.1:8091 (CTRL + C to quit)

DevTools listening on ws://127.0.0.1:8631/devtools/browser/9cdf0a12-e274-4cbe-a895-7d8564cf4315
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET / 1.1 302 223 999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET / 1.1 - - 1998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/index.html 1.1 200 3815 81017
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/index.html 1.1 - - 81017
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/videos/1.mp4 1.1 - - 8999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 206 7140 3999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 - - 3999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8642 GET /favicon.ico 1.1 404 207 1999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8642 GET /favicon.ico 1.1 - - 1999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8643 GET /favicon.ico 1.1 404 207 998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8643 GET /favicon.ico 1.1 - - 998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 - - 254000
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8644 GET /ws 1.1 101 - 996
2024-04-04 21:31:53 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'type': 'easy_wav2lip', 'audio_path': 'D:\\AI-Vtuber-20240326\\out\\edge_tts_2.mp3', 'insert_index': -1}
Loaded as API: http://127.0.0.1:7860/ ✔
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: GET http://127.0.0.1:7860/config "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: POST http://127.0.0.1:7860/upload "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: POST http://127.0.0.1:7860/queue/join "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: GET http://127.0.0.1:7860/queue/data?session_hash=677bd14c-1e72-4e29-b7c8-64f3789b8bf6 "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\api_server.py[line:90] - ERROR: Traceback (most recent call last):
  File "D:\digital_human_video_player-v0.1.2\api_server.py", line 28, in get_video
    result = client.predict(
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 404, in predict
    return self.submit(*args, api_name=api_name, fn_index=fn_index).result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1612, in result
    return super().result(timeout=timeout)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 458, in result
    return self.__get_result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 994, in _inner
    predictions = _predict(*data)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1036, in _predict
    raise ValueError(result["error"])
ValueError: None

[2024-04-04 21:31:54 +0800] [20200] [INFO] 127.0.0.1:9295 POST /show 1.1 200 62 912736
[2024-04-04 21:31:54 +0800] [20200] [INFO] 127.0.0.1:9295 POST /show 1.1 - - 913768
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'type': 'easy_wav2lip', 'audio_path': 'D:\\AI-Vtuber-20240326\\out\\edge_tts_3.mp3', 'insert_index': -1}
Loaded as API: http://127.0.0.1:7860/ ✔
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: GET http://127.0.0.1:7860/config "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: POST http://127.0.0.1:7860/upload "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: POST http://127.0.0.1:7860/queue/join "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: GET http://127.0.0.1:7860/queue/data?session_hash=cf8277c1-60cc-43fb-afdc-ff440bfc36ed "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\api_server.py[line:90] - ERROR: Traceback (most recent call last):
  File "D:\digital_human_video_player-v0.1.2\api_server.py", line 28, in get_video
    result = client.predict(
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 404, in predict
    return self.submit(*args, api_name=api_name, fn_index=fn_index).result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1612, in result
    return super().result(timeout=timeout)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 458, in result
    return self.__get_result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 994, in _inner
    predictions = _predict(*data)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1036, in _predict
    raise ValueError(result["error"])
ValueError: None

[2024-04-04 21:32:01 +0800] [20200] [INFO] 127.0.0.1:9310 POST /show 1.1 200 62 314383
[2024-04-04 21:32:01 +0800] [20200] [INFO] 127.0.0.1:9310 POST /show 1.1 - - 315385

Easy-Wav2Lip-眠-0229日志：

Active code page: 65001
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Traceback (most recent call last):
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\route_utils.py", line 235, in call_process_api
    output = await app.get_blocks().process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1618, in process_api
    inputs = await anyio.to_thread.run_sync(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1336, in preprocess_data
    inputs_cached = block.data_model(**inputs_cached)  # type: ignore
TypeError: gradio.data_classes.FileData() argument after ** must be a mapping, not str
Traceback (most recent call last):
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\route_utils.py", line 235, in call_process_api
    output = await app.get_blocks().process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1618, in process_api
    inputs = await anyio.to_thread.run_sync(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1336, in preprocess_data
    inputs_cached = block.data_model(**inputs_cached)  # type: ignore
TypeError: gradio.data_classes.FileData() argument after ** must be a mapping, not str
Ikaros-521 commented 3 months ago

感觉是sadtalker合成失败了。

大佬，我又更新了一下AI-Vtuber版本至AI-Vtuber-20240326，Easy-Wav2Lip-眠-0229有反应了，但还是报错

AI-Vtuber-20240326日志：

pygame 2.5.0 (SDL 2.28.0, Python 3.10.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
2024-04-04 21:27:20 - D:\AI-Vtuber-20240326\utils\audio.py[line:75] - INFO: 文案模式的Audio初始化...
2024-04-04 21:27:20 - D:\AI-Vtuber-20240326\webui.py[line:3985] - INFO: 本地Live2D模型名列表：['chitose', 'Haru', 'haru2', 'haruto', 'hibiki', 'Hiyori', 'koharu', 'Mao', 'miara_pro_en', 'Natori', 'nito', 'sizuku', 'tororo', 'tsumiki']
NiceGUI ready to go on http://localhost:8081
2024-04-04 21:30:41 - D:\AI-Vtuber-20240326\utils\common.py[line:775] - INFO: 写入文件:Live2D/js/model_name.js，内容：【var model_name = "Hiyori";】
2024-04-04 21:30:41 - D:\AI-Vtuber-20240326\webui.py[line:2190] - INFO: 配置数据已成功写入文件！
2024-04-04 21:31:12 - D:\AI-Vtuber-20240326\webui.py[line:253] - INFO: 运行程序: main
2024-04-04 21:31:12 - D:\AI-Vtuber-20240326\webui.py[line:328] - INFO: 程序开始 运行
pygame 2.5.0 (SDL 2.28.0, Python 3.10.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:75] - INFO: 初始化My_handle...
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:1099] - INFO: 文案播放线程运行中...
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:204] - INFO: 创 建音频合成消息队列线程
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:1189] - INFO: 重载所有文案数据
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\gpt_model\claude.py[line:28] - INFO: Claude slack_user_token or bot_user_id 为空，不进行实例化.
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\gpt_model\gpt.py[line:77] - INFO: GPT_MODEL: 进入get方法
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:225] - INFO: ./log/log-2024-4-4.txt 日志文件已存在，跳过
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:234] - INFO: ./log/comment-2024-4-4.txt 弹幕文件已存在，跳过
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:270] - INFO: 创建数据库:data/data.db
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:146] - INFO: 配置数据加载成功。
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\main.py[line:963] - INFO: 当前平台：talk
 * Serving Flask app 'main'
 * Debug mode: off
2024-04-04 21:31:36 - D:\AI-Vtuber-20240326\main.py[line:104] - INFO: API收到数 据：{'type': 'comment', 'platform': 'webui', 'username': '午夜', 'content': '你 好'}
2024-04-04 21:31:42 - D:\AI-Vtuber-20240326\webui.py[line:615] - INFO: callback 接口 收到数据：{'type': 'llm', 'data': {'type': '弹幕信息', 'username': '午夜', 'user_face': 'https://robohash.org/ui', 'content_type': 'question', 'content': '你好', 'timestamp': '2024-04-04 21:31:42'}}
2024-04-04 21:31:42 - D:\AI-Vtuber-20240326\Miniconda3\lib\site-packages\langid\langid.py[line:162] - INFO: initializing identifier
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\utils\gpt_model\chatgpt.py[line:65] - INFO: 会话ID: {'msg': [{'role': 'system', 'content': '请扮演一个AI虚拟主播。不要回答任何敏感问题！不要强调你是主播，只需要回答问题！'}, {'role': 'system', 'content': 'current time is:2024-04-04 21:31:43'}], 'id': '午夜'}
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\webui.py[line:615] - INFO: callback 接口 收到数据：{'type': 'llm', 'data': {'type': 'chatgpt', 'username': '午夜', 'content_type': 'answer', 'content': '你好！有什么我可以帮助你的吗？', 'timestamp': '2024-04-04 21:31:46'}}
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:2106] - INFO: [AI回复午夜]：你好！有什么我可以帮助你的吗？
2024-04-04 21:31:53 - D:\AI-Vtuber-20240326\utils\audio.py[line:886] - INFO: edge-tts合成成功，合成内容：【午夜说道:你好】，输出到=D:\AI-Vtuber-20240326\out\edge_tts_2.mp3
2024-04-04 21:31:54 - D:\AI-Vtuber-20240326\utils\audio.py[line:363] - INFO: digital_human_video_player发送成功，返回：视频合成失败
2024-04-04 21:32:00 - D:\AI-Vtuber-20240326\utils\audio.py[line:886] - INFO: edge-tts合成成功，合成内容：【你好！有什么我可以帮助你的吗？】，输出到=D:\AI-Vtuber-20240326\out\edge_tts_3.mp3
2024-04-04 21:32:01 - D:\AI-Vtuber-20240326\utils\audio.py[line:363] - INFO: digital_human_video_player发送成功，返回：视频合成失败

digital_human_video_player-v0.1.2日志：

[2024-04-04 21:21:14 +0800] [20200] [INFO] Running on http://127.0.0.1:8091 (CTRL + C to quit)
2024-04-04 21:21:14 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\hypercorn\logging.py[line:106] - INFO: Running on http://127.0.0.1:8091 (CTRL + C to quit)

DevTools listening on ws://127.0.0.1:8631/devtools/browser/9cdf0a12-e274-4cbe-a895-7d8564cf4315
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET / 1.1 302 223 999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET / 1.1 - - 1998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/index.html 1.1 200 3815 81017
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/index.html 1.1 - - 81017
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/videos/1.mp4 1.1 - - 8999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 206 7140 3999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 - - 3999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8642 GET /favicon.ico 1.1 404 207 1999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8642 GET /favicon.ico 1.1 - - 1999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8643 GET /favicon.ico 1.1 404 207 998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8643 GET /favicon.ico 1.1 - - 998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 - - 254000
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8644 GET /ws 1.1 101 - 996
2024-04-04 21:31:53 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'type': 'easy_wav2lip', 'audio_path': 'D:\\AI-Vtuber-20240326\\out\\edge_tts_2.mp3', 'insert_index': -1}
Loaded as API: http://127.0.0.1:7860/ ✔
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: GET http://127.0.0.1:7860/config "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: POST http://127.0.0.1:7860/upload "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: POST http://127.0.0.1:7860/queue/join "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: GET http://127.0.0.1:7860/queue/data?session_hash=677bd14c-1e72-4e29-b7c8-64f3789b8bf6 "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\api_server.py[line:90] - ERROR: Traceback (most recent call last):
  File "D:\digital_human_video_player-v0.1.2\api_server.py", line 28, in get_video
    result = client.predict(
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 404, in predict
    return self.submit(*args, api_name=api_name, fn_index=fn_index).result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1612, in result
    return super().result(timeout=timeout)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 458, in result
    return self.__get_result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 994, in _inner
    predictions = _predict(*data)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1036, in _predict
    raise ValueError(result["error"])
ValueError: None

[2024-04-04 21:31:54 +0800] [20200] [INFO] 127.0.0.1:9295 POST /show 1.1 200 62 912736
[2024-04-04 21:31:54 +0800] [20200] [INFO] 127.0.0.1:9295 POST /show 1.1 - - 913768
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'type': 'easy_wav2lip', 'audio_path': 'D:\\AI-Vtuber-20240326\\out\\edge_tts_3.mp3', 'insert_index': -1}
Loaded as API: http://127.0.0.1:7860/ ✔
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: GET http://127.0.0.1:7860/config "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: POST http://127.0.0.1:7860/upload "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: POST http://127.0.0.1:7860/queue/join "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: GET http://127.0.0.1:7860/queue/data?session_hash=cf8277c1-60cc-43fb-afdc-ff440bfc36ed "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\api_server.py[line:90] - ERROR: Traceback (most recent call last):
  File "D:\digital_human_video_player-v0.1.2\api_server.py", line 28, in get_video
    result = client.predict(
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 404, in predict
    return self.submit(*args, api_name=api_name, fn_index=fn_index).result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1612, in result
    return super().result(timeout=timeout)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 458, in result
    return self.__get_result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 994, in _inner
    predictions = _predict(*data)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1036, in _predict
    raise ValueError(result["error"])
ValueError: None

[2024-04-04 21:32:01 +0800] [20200] [INFO] 127.0.0.1:9310 POST /show 1.1 200 62 314383
[2024-04-04 21:32:01 +0800] [20200] [INFO] 127.0.0.1:9310 POST /show 1.1 - - 315385

Easy-Wav2Lip-眠-0229日志：

Active code page: 65001
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Traceback (most recent call last):
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\route_utils.py", line 235, in call_process_api
    output = await app.get_blocks().process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1618, in process_api
    inputs = await anyio.to_thread.run_sync(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1336, in preprocess_data
    inputs_cached = block.data_model(**inputs_cached)  # type: ignore
TypeError: gradio.data_classes.FileData() argument after ** must be a mapping, not str
Traceback (most recent call last):
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\route_utils.py", line 235, in call_process_api
    output = await app.get_blocks().process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1618, in process_api
    inputs = await anyio.to_thread.run_sync(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1336, in preprocess_data
    inputs_cached = block.data_model(**inputs_cached)  # type: ignore
TypeError: gradio.data_classes.FileData() argument after ** must be a mapping, not str

主要问题在gradio

Ikaros-521 commented 3 months ago

看着新版本接口变了。不过旧版本不匹配到倒是个问题

Ikaros-521 commented 3 months ago

哦 你用的easy wav2lip，看错了....

Ikaros-521 commented 3 months ago

image 0229版本 没问题

Ikaros-521 commented 3 months ago

image image 需要匹配

Night42 commented 3 months ago

image image 需要匹配

这样是不是算匹配上了，但就是还是报上面的那个错误： 屏幕截图 2024-04-05 163826 屏幕截图 2024-04-05 163850 屏幕截图 2024-04-05 163901

Ikaros-521 commented 3 months ago

image image 需要匹配

这样是不是算匹配上了，但就是还是报上面的那个错误： 屏幕截图 2024-04-05 163826 屏幕截图 2024-04-05 163850 屏幕截图 2024-04-05 163901

image 这个

Night42 commented 3 months ago

image image 需要匹配

这样是不是算匹配上了，但就是还是报上面的那个错误： 屏幕截图 2024-04-05 163826 屏幕截图 2024-04-05 163850 屏幕截图 2024-04-05 163901

image 这个

这样是对的吗，还是报一样的错误： 屏幕截图 2024-04-05 195949 屏幕截图 2024-04-05 193407 屏幕截图 2024-04-05 193432

Night42 commented 3 months ago

这样好像也不行： 屏幕截图 2024-04-05 201457

Ikaros-521 commented 3 months ago

这样好像也不行： 屏幕截图 2024-04-05 201457

什么报错

Night42 commented 3 months ago

这样好像也不行： 屏幕截图 2024-04-05 201457

什么报错

跟这个一样：

感觉是sadtalker合成失败了。

大佬，我又更新了一下AI-Vtuber版本至AI-Vtuber-20240326，Easy-Wav2Lip-眠-0229有反应了，但还是报错

AI-Vtuber-20240326日志：

pygame 2.5.0 (SDL 2.28.0, Python 3.10.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
2024-04-04 21:27:20 - D:\AI-Vtuber-20240326\utils\audio.py[line:75] - INFO: 文案模式的Audio初始化...
2024-04-04 21:27:20 - D:\AI-Vtuber-20240326\webui.py[line:3985] - INFO: 本地Live2D模型名列表：['chitose', 'Haru', 'haru2', 'haruto', 'hibiki', 'Hiyori', 'koharu', 'Mao', 'miara_pro_en', 'Natori', 'nito', 'sizuku', 'tororo', 'tsumiki']
NiceGUI ready to go on http://localhost:8081
2024-04-04 21:30:41 - D:\AI-Vtuber-20240326\utils\common.py[line:775] - INFO: 写入文件:Live2D/js/model_name.js，内容：【var model_name = "Hiyori";】
2024-04-04 21:30:41 - D:\AI-Vtuber-20240326\webui.py[line:2190] - INFO: 配置数据已成功写入文件！
2024-04-04 21:31:12 - D:\AI-Vtuber-20240326\webui.py[line:253] - INFO: 运行程序: main
2024-04-04 21:31:12 - D:\AI-Vtuber-20240326\webui.py[line:328] - INFO: 程序开始 运行
pygame 2.5.0 (SDL 2.28.0, Python 3.10.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:75] - INFO: 初始化My_handle...
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:1099] - INFO: 文案播放线程运行中...
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:204] - INFO: 创 建音频合成消息队列线程
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:1189] - INFO: 重载所有文案数据
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\gpt_model\claude.py[line:28] - INFO: Claude slack_user_token or bot_user_id 为空，不进行实例化.
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\gpt_model\gpt.py[line:77] - INFO: GPT_MODEL: 进入get方法
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:225] - INFO: ./log/log-2024-4-4.txt 日志文件已存在，跳过
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:234] - INFO: ./log/comment-2024-4-4.txt 弹幕文件已存在，跳过
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:270] - INFO: 创建数据库:data/data.db
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:146] - INFO: 配置数据加载成功。
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\main.py[line:963] - INFO: 当前平台：talk
 * Serving Flask app 'main'
 * Debug mode: off
2024-04-04 21:31:36 - D:\AI-Vtuber-20240326\main.py[line:104] - INFO: API收到数 据：{'type': 'comment', 'platform': 'webui', 'username': '午夜', 'content': '你 好'}
2024-04-04 21:31:42 - D:\AI-Vtuber-20240326\webui.py[line:615] - INFO: callback 接口 收到数据：{'type': 'llm', 'data': {'type': '弹幕信息', 'username': '午夜', 'user_face': 'https://robohash.org/ui', 'content_type': 'question', 'content': '你好', 'timestamp': '2024-04-04 21:31:42'}}
2024-04-04 21:31:42 - D:\AI-Vtuber-20240326\Miniconda3\lib\site-packages\langid\langid.py[line:162] - INFO: initializing identifier
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\utils\gpt_model\chatgpt.py[line:65] - INFO: 会话ID: {'msg': [{'role': 'system', 'content': '请扮演一个AI虚拟主播。不要回答任何敏感问题！不要强调你是主播，只需要回答问题！'}, {'role': 'system', 'content': 'current time is:2024-04-04 21:31:43'}], 'id': '午夜'}
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\webui.py[line:615] - INFO: callback 接口 收到数据：{'type': 'llm', 'data': {'type': 'chatgpt', 'username': '午夜', 'content_type': 'answer', 'content': '你好！有什么我可以帮助你的吗？', 'timestamp': '2024-04-04 21:31:46'}}
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:2106] - INFO: [AI回复午夜]：你好！有什么我可以帮助你的吗？
2024-04-04 21:31:53 - D:\AI-Vtuber-20240326\utils\audio.py[line:886] - INFO: edge-tts合成成功，合成内容：【午夜说道:你好】，输出到=D:\AI-Vtuber-20240326\out\edge_tts_2.mp3
2024-04-04 21:31:54 - D:\AI-Vtuber-20240326\utils\audio.py[line:363] - INFO: digital_human_video_player发送成功，返回：视频合成失败
2024-04-04 21:32:00 - D:\AI-Vtuber-20240326\utils\audio.py[line:886] - INFO: edge-tts合成成功，合成内容：【你好！有什么我可以帮助你的吗？】，输出到=D:\AI-Vtuber-20240326\out\edge_tts_3.mp3
2024-04-04 21:32:01 - D:\AI-Vtuber-20240326\utils\audio.py[line:363] - INFO: digital_human_video_player发送成功，返回：视频合成失败

digital_human_video_player-v0.1.2日志：

[2024-04-04 21:21:14 +0800] [20200] [INFO] Running on http://127.0.0.1:8091 (CTRL + C to quit)
2024-04-04 21:21:14 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\hypercorn\logging.py[line:106] - INFO: Running on http://127.0.0.1:8091 (CTRL + C to quit)

DevTools listening on ws://127.0.0.1:8631/devtools/browser/9cdf0a12-e274-4cbe-a895-7d8564cf4315
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET / 1.1 302 223 999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET / 1.1 - - 1998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/index.html 1.1 200 3815 81017
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/index.html 1.1 - - 81017
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/videos/1.mp4 1.1 - - 8999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 206 7140 3999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 - - 3999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8642 GET /favicon.ico 1.1 404 207 1999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8642 GET /favicon.ico 1.1 - - 1999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8643 GET /favicon.ico 1.1 404 207 998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8643 GET /favicon.ico 1.1 - - 998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 - - 254000
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8644 GET /ws 1.1 101 - 996
2024-04-04 21:31:53 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'type': 'easy_wav2lip', 'audio_path': 'D:\\AI-Vtuber-20240326\\out\\edge_tts_2.mp3', 'insert_index': -1}
Loaded as API: http://127.0.0.1:7860/ ✔
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: GET http://127.0.0.1:7860/config "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: POST http://127.0.0.1:7860/upload "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: POST http://127.0.0.1:7860/queue/join "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: GET http://127.0.0.1:7860/queue/data?session_hash=677bd14c-1e72-4e29-b7c8-64f3789b8bf6 "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\api_server.py[line:90] - ERROR: Traceback (most recent call last):
  File "D:\digital_human_video_player-v0.1.2\api_server.py", line 28, in get_video
    result = client.predict(
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 404, in predict
    return self.submit(*args, api_name=api_name, fn_index=fn_index).result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1612, in result
    return super().result(timeout=timeout)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 458, in result
    return self.__get_result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 994, in _inner
    predictions = _predict(*data)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1036, in _predict
    raise ValueError(result["error"])
ValueError: None

[2024-04-04 21:31:54 +0800] [20200] [INFO] 127.0.0.1:9295 POST /show 1.1 200 62 912736
[2024-04-04 21:31:54 +0800] [20200] [INFO] 127.0.0.1:9295 POST /show 1.1 - - 913768
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'type': 'easy_wav2lip', 'audio_path': 'D:\\AI-Vtuber-20240326\\out\\edge_tts_3.mp3', 'insert_index': -1}
Loaded as API: http://127.0.0.1:7860/ ✔
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: GET http://127.0.0.1:7860/config "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: POST http://127.0.0.1:7860/upload "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: POST http://127.0.0.1:7860/queue/join "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: GET http://127.0.0.1:7860/queue/data?session_hash=cf8277c1-60cc-43fb-afdc-ff440bfc36ed "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\api_server.py[line:90] - ERROR: Traceback (most recent call last):
  File "D:\digital_human_video_player-v0.1.2\api_server.py", line 28, in get_video
    result = client.predict(
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 404, in predict
    return self.submit(*args, api_name=api_name, fn_index=fn_index).result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1612, in result
    return super().result(timeout=timeout)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 458, in result
    return self.__get_result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 994, in _inner
    predictions = _predict(*data)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1036, in _predict
    raise ValueError(result["error"])
ValueError: None

[2024-04-04 21:32:01 +0800] [20200] [INFO] 127.0.0.1:9310 POST /show 1.1 200 62 314383
[2024-04-04 21:32:01 +0800] [20200] [INFO] 127.0.0.1:9310 POST /show 1.1 - - 315385

Easy-Wav2Lip-眠-0229日志：

Active code page: 65001
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Traceback (most recent call last):
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\route_utils.py", line 235, in call_process_api
    output = await app.get_blocks().process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1618, in process_api
    inputs = await anyio.to_thread.run_sync(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1336, in preprocess_data
    inputs_cached = block.data_model(**inputs_cached)  # type: ignore
TypeError: gradio.data_classes.FileData() argument after ** must be a mapping, not str
Traceback (most recent call last):
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\route_utils.py", line 235, in call_process_api
    output = await app.get_blocks().process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1618, in process_api
    inputs = await anyio.to_thread.run_sync(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1336, in preprocess_data
    inputs_cached = block.data_model(**inputs_cached)  # type: ignore
TypeError: gradio.data_classes.FileData() argument after ** must be a mapping, not str
Ikaros-521 commented 3 months ago

这样好像也不行： 屏幕截图 2024-04-05 201457

什么报错

跟这个一样：

感觉是sadtalker合成失败了。

大佬，我又更新了一下AI-Vtuber版本至AI-Vtuber-20240326，Easy-Wav2Lip-眠-0229有反应了，但还是报错

AI-Vtuber-20240326日志：

pygame 2.5.0 (SDL 2.28.0, Python 3.10.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
2024-04-04 21:27:20 - D:\AI-Vtuber-20240326\utils\audio.py[line:75] - INFO: 文案模式的Audio初始化...
2024-04-04 21:27:20 - D:\AI-Vtuber-20240326\webui.py[line:3985] - INFO: 本地Live2D模型名列表：['chitose', 'Haru', 'haru2', 'haruto', 'hibiki', 'Hiyori', 'koharu', 'Mao', 'miara_pro_en', 'Natori', 'nito', 'sizuku', 'tororo', 'tsumiki']
NiceGUI ready to go on http://localhost:8081
2024-04-04 21:30:41 - D:\AI-Vtuber-20240326\utils\common.py[line:775] - INFO: 写入文件:Live2D/js/model_name.js，内容：【var model_name = "Hiyori";】
2024-04-04 21:30:41 - D:\AI-Vtuber-20240326\webui.py[line:2190] - INFO: 配置数据已成功写入文件！
2024-04-04 21:31:12 - D:\AI-Vtuber-20240326\webui.py[line:253] - INFO: 运行程序: main
2024-04-04 21:31:12 - D:\AI-Vtuber-20240326\webui.py[line:328] - INFO: 程序开始 运行
pygame 2.5.0 (SDL 2.28.0, Python 3.10.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:75] - INFO: 初始化My_handle...
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:1099] - INFO: 文案播放线程运行中...
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:204] - INFO: 创 建音频合成消息队列线程
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\audio.py[line:1189] - INFO: 重载所有文案数据
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\gpt_model\claude.py[line:28] - INFO: Claude slack_user_token or bot_user_id 为空，不进行实例化.
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\gpt_model\gpt.py[line:77] - INFO: GPT_MODEL: 进入get方法
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:225] - INFO: ./log/log-2024-4-4.txt 日志文件已存在，跳过
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:234] - INFO: ./log/comment-2024-4-4.txt 弹幕文件已存在，跳过
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:270] - INFO: 创建数据库:data/data.db
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:146] - INFO: 配置数据加载成功。
2024-04-04 21:31:17 - D:\AI-Vtuber-20240326\main.py[line:963] - INFO: 当前平台：talk
 * Serving Flask app 'main'
 * Debug mode: off
2024-04-04 21:31:36 - D:\AI-Vtuber-20240326\main.py[line:104] - INFO: API收到数 据：{'type': 'comment', 'platform': 'webui', 'username': '午夜', 'content': '你 好'}
2024-04-04 21:31:42 - D:\AI-Vtuber-20240326\webui.py[line:615] - INFO: callback 接口 收到数据：{'type': 'llm', 'data': {'type': '弹幕信息', 'username': '午夜', 'user_face': 'https://robohash.org/ui', 'content_type': 'question', 'content': '你好', 'timestamp': '2024-04-04 21:31:42'}}
2024-04-04 21:31:42 - D:\AI-Vtuber-20240326\Miniconda3\lib\site-packages\langid\langid.py[line:162] - INFO: initializing identifier
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\utils\gpt_model\chatgpt.py[line:65] - INFO: 会话ID: {'msg': [{'role': 'system', 'content': '请扮演一个AI虚拟主播。不要回答任何敏感问题！不要强调你是主播，只需要回答问题！'}, {'role': 'system', 'content': 'current time is:2024-04-04 21:31:43'}], 'id': '午夜'}
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\webui.py[line:615] - INFO: callback 接口 收到数据：{'type': 'llm', 'data': {'type': 'chatgpt', 'username': '午夜', 'content_type': 'answer', 'content': '你好！有什么我可以帮助你的吗？', 'timestamp': '2024-04-04 21:31:46'}}
2024-04-04 21:31:46 - D:\AI-Vtuber-20240326\utils\my_handle.py[line:2106] - INFO: [AI回复午夜]：你好！有什么我可以帮助你的吗？
2024-04-04 21:31:53 - D:\AI-Vtuber-20240326\utils\audio.py[line:886] - INFO: edge-tts合成成功，合成内容：【午夜说道:你好】，输出到=D:\AI-Vtuber-20240326\out\edge_tts_2.mp3
2024-04-04 21:31:54 - D:\AI-Vtuber-20240326\utils\audio.py[line:363] - INFO: digital_human_video_player发送成功，返回：视频合成失败
2024-04-04 21:32:00 - D:\AI-Vtuber-20240326\utils\audio.py[line:886] - INFO: edge-tts合成成功，合成内容：【你好！有什么我可以帮助你的吗？】，输出到=D:\AI-Vtuber-20240326\out\edge_tts_3.mp3
2024-04-04 21:32:01 - D:\AI-Vtuber-20240326\utils\audio.py[line:363] - INFO: digital_human_video_player发送成功，返回：视频合成失败

digital_human_video_player-v0.1.2日志：

[2024-04-04 21:21:14 +0800] [20200] [INFO] Running on http://127.0.0.1:8091 (CTRL + C to quit)
2024-04-04 21:21:14 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\hypercorn\logging.py[line:106] - INFO: Running on http://127.0.0.1:8091 (CTRL + C to quit)

DevTools listening on ws://127.0.0.1:8631/devtools/browser/9cdf0a12-e274-4cbe-a895-7d8564cf4315
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET / 1.1 302 223 999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET / 1.1 - - 1998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/index.html 1.1 200 3815 81017
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/index.html 1.1 - - 81017
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8638 GET /static/videos/1.mp4 1.1 - - 8999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 206 7140 3999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 - - 3999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8642 GET /favicon.ico 1.1 404 207 1999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8642 GET /favicon.ico 1.1 - - 1999
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8643 GET /favicon.ico 1.1 404 207 998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8643 GET /favicon.ico 1.1 - - 998
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8639 GET /static/videos/1.mp4 1.1 - - 254000
[2024-04-04 21:21:28 +0800] [20200] [INFO] 127.0.0.1:8644 GET /ws 1.1 101 - 996
2024-04-04 21:31:53 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'type': 'easy_wav2lip', 'audio_path': 'D:\\AI-Vtuber-20240326\\out\\edge_tts_2.mp3', 'insert_index': -1}
Loaded as API: http://127.0.0.1:7860/ ✔
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: GET http://127.0.0.1:7860/config "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: POST http://127.0.0.1:7860/upload "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: POST http://127.0.0.1:7860/queue/join "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: GET http://127.0.0.1:7860/queue/data?session_hash=677bd14c-1e72-4e29-b7c8-64f3789b8bf6 "HTTP/1.1 200 OK"
2024-04-04 21:31:54 - D:\digital_human_video_player-v0.1.2\api_server.py[line:90] - ERROR: Traceback (most recent call last):
  File "D:\digital_human_video_player-v0.1.2\api_server.py", line 28, in get_video
    result = client.predict(
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 404, in predict
    return self.submit(*args, api_name=api_name, fn_index=fn_index).result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1612, in result
    return super().result(timeout=timeout)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 458, in result
    return self.__get_result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 994, in _inner
    predictions = _predict(*data)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1036, in _predict
    raise ValueError(result["error"])
ValueError: None

[2024-04-04 21:31:54 +0800] [20200] [INFO] 127.0.0.1:9295 POST /show 1.1 200 62 912736
[2024-04-04 21:31:54 +0800] [20200] [INFO] 127.0.0.1:9295 POST /show 1.1 - - 913768
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\api_server.py[line:120] - INFO: 收到数据：{'type': 'easy_wav2lip', 'audio_path': 'D:\\AI-Vtuber-20240326\\out\\edge_tts_3.mp3', 'insert_index': -1}
Loaded as API: http://127.0.0.1:7860/ ✔
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: GET http://127.0.0.1:7860/config "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1026] - INFO: HTTP Request: POST http://127.0.0.1:7860/upload "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: POST http://127.0.0.1:7860/queue/join "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\httpx\_client.py[line:1773] - INFO: HTTP Request: GET http://127.0.0.1:7860/queue/data?session_hash=cf8277c1-60cc-43fb-afdc-ff440bfc36ed "HTTP/1.1 200 OK"
2024-04-04 21:32:01 - D:\digital_human_video_player-v0.1.2\api_server.py[line:90] - ERROR: Traceback (most recent call last):
  File "D:\digital_human_video_player-v0.1.2\api_server.py", line 28, in get_video
    result = client.predict(
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 404, in predict
    return self.submit(*args, api_name=api_name, fn_index=fn_index).result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1612, in result
    return super().result(timeout=timeout)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 458, in result
    return self.__get_result()
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 994, in _inner
    predictions = _predict(*data)
  File "D:\digital_human_video_player-v0.1.2\Miniconda3\lib\site-packages\gradio_client\client.py", line 1036, in _predict
    raise ValueError(result["error"])
ValueError: None

[2024-04-04 21:32:01 +0800] [20200] [INFO] 127.0.0.1:9310 POST /show 1.1 200 62 314383
[2024-04-04 21:32:01 +0800] [20200] [INFO] 127.0.0.1:9310 POST /show 1.1 - - 315385

Easy-Wav2Lip-眠-0229日志：

Active code page: 65001
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Traceback (most recent call last):
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\route_utils.py", line 235, in call_process_api
    output = await app.get_blocks().process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1618, in process_api
    inputs = await anyio.to_thread.run_sync(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1336, in preprocess_data
    inputs_cached = block.data_model(**inputs_cached)  # type: ignore
TypeError: gradio.data_classes.FileData() argument after ** must be a mapping, not str
Traceback (most recent call last):
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\route_utils.py", line 235, in call_process_api
    output = await app.get_blocks().process_api(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1618, in process_api
    inputs = await anyio.to_thread.run_sync(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "D:\Easy-Wav2Lip-眠-0229\venv\lib\site-packages\gradio\blocks.py", line 1336, in preprocess_data
    inputs_cached = block.data_model(**inputs_cached)  # type: ignore
TypeError: gradio.data_classes.FileData() argument after ** must be a mapping, not str

看着是接口的文件解析有问题。要么降版本吧，或者等我有空看看

Night42 commented 3 months ago

看着是接口的文件解析有问题。要么降版本吧，或者等我有空看看

好的，是把AI-Vtuber、digital_human_video_player、Easy-Wav2Lip中的哪个降一下版本

Ikaros-521 commented 3 months ago

看着是接口的文件解析有问题。要么降版本吧，或者等我有空看看

好的，是把AI-Vtuber、digital_human_video_player、Easy-Wav2Lip中的哪个降一下版本

Easy-Wav2Lip

Ikaros-521 commented 3 months ago

Easy-Wav2Lip-0229 按理说是匹配的，你这webui怎么不一样

Night42 commented 3 months ago

Easy-Wav2Lip-0229 按理说是匹配的，你这webui怎么不一样

不清楚，下载的Easy-Wav2Lip-0229整合包启动后就是暗色主题了 亮色主题的话就得在端口后面加?theme=light变成http://127.0.0.1:7860/?theme=light 才行： 屏幕截图 2024-04-06 202446

Ikaros-521 commented 3 months ago

Easy-Wav2Lip-0229 按理说是匹配的，你这webui怎么不一样

不清楚，下载的Easy-Wav2Lip-0229整合包启动后就是暗色主题了 亮色主题的话就得在端口后面加?theme=light变成http://127.0.0.1:7860/?theme=light 才行： 屏幕截图 2024-04-06 202446

主题这倒是无所谓 但是接口不匹配才是最搞的

Ikaros-521 commented 3 months ago

今晚9点多左右，有空的话可以开个远程看看

Night42 commented 3 months ago

今晚9点多左右，有空的话可以开个远程看看

好嘞，请问如何加你

Ikaros-521 commented 3 months ago

今晚9点多左右，有空的话可以开个远程看看

好嘞，请问如何加你

q群：587663288 密:3709626

Ikaros-521 commented 3 months ago

修改config.json，easy_wav2lip 的 video_file 路径 \ 为 / 格式

"easy_wav2lip": {
        "api_ip_port": "http://127.0.0.1:7860",
        "video_file": "D:/digital_human_video_player-v0.1.2/static/imgs/1.png",