Chenyme / Chenyme-AAVT

这是一个全自动(音频)视频翻译项目。利用Whisper识别声音,AI大模型翻译字幕,最后合并字幕视频,生成翻译后的视频。
MIT License
1.69k stars 153 forks source link

【错误】[音频识别] 的 [未知错误] #53

Open WuZhiMing2 opened 2 months ago

WuZhiMing2 commented 2 months ago

操作系统

WIN11

项目版本

0.9

Python版本

1.12.5

错误描述

ルッカースをどうもり合わせってやつですね。 そうです。 という訳で楽しんでいただいて、ください。 これに楽しめるって、そう いうことなんでいいの。 でも、明らうは楽しいです。 んん、ごめんなさい。 えっえーっと こんな形のサンドバックですが えぇ バック 実用制はかいむ 申し訳ございません ああ・・・ ああ・・・ ああ・・・ ああ・・・ これからも アキラのやりたいことと好きなこと あと、刺してることで これからも続いていくと思います あと、トラブル! うん! ああ・・・ これからもよろしくお願いします ああ・・・ めちゃくちゃ 下気持ち悪いって事だけわかりますね という訳で 本日も サイズマッコークリをいただき まっかりに ありがとうございました ハラバンもしましたね あぁ またの コリをお待ちしておりますね 必然いたします

[❌ ERROR] 运行出错!

"若显示 缺失 fbgemm.dll,请使用Install选择修复版本!" "若显示 缺失 cudnn_ops_infer64_8.dll 请前往GitHub下载相关dll!" "若有其他报错,请阅读常见问题,或前往GitHub 或 群组讨论!"

重现步骤

第一步,设置GPU加速
第二步,添加文件
第三步,识别

错误截图

No response

其他信息(可选)

image image

Chenyme commented 2 months ago

您好!根据截图未发现错误内容无法定位,能否试试不使用cuda模型是否正常?

WuZhiMing2 commented 2 months ago

您好!根据截图未发现错误内容无法定位,能否试试不使用cuda模型是否正常?

不使用cuda,使用cpu也是一样的报错。从日志上看没有任何区别。由于音频文件太大,我也无法在此提供文件

ccchan49 commented 2 months ago

。。。之前在错的issue里面回复了,我遇到的是这个问题,不是API报错(设置了无需翻译)

WuZhiMing2 commented 2 months ago

您好!根据截图未发现错误内容无法定位,能否试试不使用cuda模型是否正常?

或者您这边有什么渠道可以让我上传待处理的源文件吗

Chenyme commented 2 months ago

你好,我可能已经找到问题所在,能否让您的环境测试一下?如果可以希望能在电报群内@我一下?感谢!

Chenyme commented 2 months ago

。。。之前在错的issue里面回复了,我遇到的是这个问题,不是API报错(设置了无需翻译)

你好,我可能已经找到问题所在,能否使用您的环境测试一下(我手头没有遇到这种问题的环境)?如果可以希望可以提供一下联系方式,非常感谢~

ccchan49 commented 2 months ago

。。。之前在错的issue里面回复了,我遇到的是这个问题,不是API报错(设置了无需翻译)

你好,我可能已经找到问题所在,能否使用您的环境测试一下(我手头没有遇到这种问题的环境)?如果可以希望可以提供一下联系方式,非常感谢~

没有telegram,可以直接把文件传到网盘然后给个链接么?

Chenyme commented 2 months ago

。。。之前在错的issue里面回复了,我遇到的是这个问题,不是API报错(设置了无需翻译)

你好,我可能已经找到问题所在,能否使用您的环境测试一下(我手头没有遇到这种问题的环境)?如果可以希望可以提供一下联系方式,非常感谢~

没有telegram,可以直接把文件传到网盘然后给个链接么?

加我v吧:chenyme03

WuZhiMing2 commented 2 months ago

。。。之前在错的issue里面回复了,我遇到的是这个问题,不是API报错(设置了无需翻译)

你好,我可能已经找到问题所在,能否使用您的环境测试一下(我手头没有遇到这种问题的环境)?如果可以希望可以提供一下联系方式,非常感谢~

国内不太好上电报,是否有其他方式呢?

2468785842 commented 1 month ago

我也出现这个问题了,经过我排查发现是native c++层面的错误, 开启faulthandler,打印堆栈: import faulthandler faulthandler.enable()

出现错误(不开启faulthandler是没有任何输出): 📝 Whisper识别结果: The stars leaned down to kiss you. And I lie awake, can't miss you. Bored me a heavy dose of atmosphere. He's out those off safe and sadly. How miss your arms around me, I'll send a postcard to you dear, I wish you- Cause the space is between my f- Cause cold nostalgicouts when I- Fatal Python error: Aborted

Thread 0x000036dc (most recent call first): File "D:\Python311\Lib\concurrent\futures\thread.py", line 58 in run File "D:\Python311\Lib\concurrent\futures\thread.py", line 83 in _worker File "D:\Python311\Lib\threading.py", line 975 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x000036d8 (most recent call first): File "D:\Python311\Lib\threading.py", line 320 in wait File "D:\Python311\Lib\concurrent\futures_base.py", line 451 in result File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\utils\public.py", line 186 in runWhisperSeperateProc File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\page\project\audio.py", line 388 in File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\streamlit\navigation\page.py", line 291 in run File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\Chenyme-AAVT.py", line 45 in File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 576 in code_to_exec File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\streamlit\runtime\scriptrunner\exec_code.py", line 85 in exec_func_with_error_handling File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 592 in _run_script File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 313 in _run_script_thread File "D:\Python311\Lib\threading.py", line 975 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x00004760 (most recent call first): File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 351 in read_directory_changes File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 405 in read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 69 in _read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 72 in queue_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\api.py", line 157 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x000027f8 (most recent call first): File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 351 in read_directory_changes File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 405 in read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 69 in _read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 72 in queue_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\api.py", line 157 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x000046bc (most recent call first): File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 351 in read_directory_changes File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 405 in read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 69 in _read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 72 in queue_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\api.py", line 157 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x0000461c (most recent call first): File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 351 in read_directory_changes File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 405 in read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 69 in _read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 72 in queue_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\api.py", line 157 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x000044a0 (most recent call first): File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 351 in read_directory_changes File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 405 in read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 69 in _read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 72 in queue_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\api.py", line 157 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x00000abc (most recent call first): File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 351 in read_directory_changes File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 405 in read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 69 in _read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 72 in queue_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\api.py", line 157 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x00002378 (most recent call first): File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 351 in read_directory_changes File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\winapi.py", line 405 in read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 69 in _read_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\read_directory_changes.py", line 72 in queue_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\api.py", line 157 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x000033f0 (most recent call first): File "D:\Python311\Lib\threading.py", line 320 in wait File "D:\Python311\Lib\queue.py", line 171 in get File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\api.py", line 375 in dispatch_events File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\watchdog\observers\api.py", line 212 in run File "D:\Python311\Lib\threading.py", line 1038 in _bootstrap_inner File "D:\Python311\Lib\threading.py", line 995 in _bootstrap

Thread 0x00000e28 (most recent call first): File "D:\Python311\Lib\selectors.py", line 314 in _select File "D:\Python311\Lib\selectors.py", line 323 in select File "D:\Python311\Lib\asyncio\base_events.py", line 1884 in _run_once File "D:\Python311\Lib\asyncio\base_events.py", line 607 in run_forever File "D:\Python311\Lib\asyncio\base_events.py", line 640 in run_until_complete File "D:\Python311\Lib\asyncio\runners.py", line 118 in run File "D:\Python311\Lib\asyncio\runners.py", line 190 in run File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\streamlit\web\bootstrap.py", line 352 in run File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\streamlit\web\cli.py", line 274 in _main_run File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\streamlit\web\cli.py", line 238 in main_run File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\click\core.py", line 783 in invoke File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\click\core.py", line 1434 in invoke File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\click\core.py", line 1688 in invoke File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\click\core.py", line 1078 in main File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Lib\site-packages\click\core.py", line 1157 in call File "D:\Users\Li_Dong\PythonProject\Chenyme-AAVT\env\Scripts\streamlit.exe__main__.py", line 7 in File "", line 88 in _run_code File "", line 198 in _run_module_as_main

Extension modules: google._upb._message, tornado.speedups, charset_normalizer.md, requests.packages.charset_normalizer.md, requests.packages.chardet.md, av._core, av.logging, av.bytesource, av.buffer, av.audio.format, av.enum, av.error, av.utils, av.option, av.descriptor, av.container.pyio, av.dictionary, av.format, av.stream, av.container.streams, av.sidedata.motionvectors, av.sidedata.sidedata, av.packet, av.container.input, av.container.output, av.container.core, av.codec.context, av.video.format, av.video.reformatter, av.plane, av.video.plane, av.video.frame, av.video.stream, av.codec.codec, av.frame, av.audio.layout, av.audio.plane, av.audio.frame, av.audio.stream, av.audio.fifo, av.filter.pad, av.filter.link, av.filter.context, av.filter.graph, av.filter.filter, av.audio.resampler, av.bitstream, numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, torch._C, torch._C._fft, torch._C._linalg, torch._C._nested, torch._C._nn, torch._C._sparse, torch._C._special, yaml._yaml, pyarrow.lib, pandas._libs.tslibs.ccalendar, pandas._libs.tslibs.np_datetime, pandas._libs.tslibs.dtypes, pandas._libs.tslibs.base, pandas._libs.tslibs.nattype, pandas._libs.tslibs.timezones, pandas._libs.tslibs.fields, pandas._libs.tslibs.timedeltas, pandas._libs.tslibs.tzconversion, pandas._libs.tslibs.timestamps, pandas._libs.properties, pandas._libs.tslibs.offsets, pandas._libs.tslibs.strptime, pandas._libs.tslibs.parsing, pandas._libs.tslibs.conversion, pandas._libs.tslibs.period, pandas._libs.tslibs.vectorized, pandas._libs.ops_dispatch, pandas._libs.missing, pandas._libs.hashtable, pandas._libs.algos, pandas._libs.interval, pandas._libs.lib, pyarrow._compute, pandas._libs.ops, pandas._libs.hashing, pandas._libs.arrays, pandas._libs.tslib, pandas._libs.sparse, pandas._libs.internals, pandas._libs.indexing, pandas._libs.index, pandas._libs.writers, pandas._libs.join, pandas._libs.window.aggregations, pandas._libs.window.indexers, pandas._libs.reshape, pandas._libs.groupby, pandas._libs.json, pandas._libs.parsers, pandas._libs.testing, grpc._cython.cygrpc, PIL._imaging, av.audio.codeccontext (total: 113)

AppData\Local\CrashDumps: 操作系统转储的dmp文件信息: 屏幕截图 2024-09-06 083217

经过我的debug发现是: 每次调用env\Lib\site-packages\faster_whisper\transcribe.py的generate_segments都会出错???(我不太确定)

有点难搞....... 我猜是streamlit和whisper之间的线程处理问题.....

Chenyme commented 1 month ago

@WuZhiMing2 @ccchan49 @2468785842


感谢您的测试以及上面各位的反馈,这个堆栈错误其实是由于faster-whisper原生库导致,之前是用启动新进程来规避,但目前streamlit新版本直接启动新进程会失败。暂时无法修复,我正在寻找解决办法! 您目前可以尝试设置faster-whisper后端的temperature为0来规避此错误。我会尽快找出解决办法并修复!

WuZhiMing2 commented 1 month ago

temperature

请问下,这个设置在哪里呢?

2468785842 commented 1 month ago

@WuZhiMing2 @ccchan49 @2468785842

感谢您的测试以及上面各位的反馈,这个堆栈错误其实是由于faster-whisper原生库导致,之前是用启动新进程来规避,但目前streamlit新版本直接启动新进程会失败。暂时无法修复,我正在寻找解决办法! 您目前可以尝试设置faster-whisper后端的temperature为0来规避此错误。我会尽快找出解决办法并修复!

我这里给你提个解决方法和建议, 可以尝试将streamlit和Whisper分离成两个完全不相干的进程,中间用 rpc (http什么的也行) 进行通信,Whisper是服务端, Streamlit是客户端

我在本地修改了个rpc调用demo,发现是可行的

(我本来想从源码调试看看到底是怎么回事,发现py和c++混合调试还是太困难了vscode的插件debug不了有时候莫名卡死而且不能跳到c++源码, 可能得vs来混合调试才行最后放弃了...)

下面是我修改的demo的截图:

Snipaste_2024-09-14_22-45-39

WangXinjianNB commented 1 week ago

temperature

请问下,这个设置在哪里呢?

把utils文件中的public.py代码中第156行的代码进行修改 "temperature": 0