search

jerryuhoo / VTuberTalk

Apache License 2.0
372 stars 53 forks source link

requirements.txt依赖冲突 #14

Closed prophesier closed 2 years ago

prophesier commented 2 years ago

paddlespeech==0.2.0 spleeter==2.3.0 这两条会产生如下的冲突报错


ERROR: Cannot install -r requirements.txt (line 2) and -r requirements.txt (line 4) because these package versions have conflicting dependencies.

The conflict is caused by:
    paddlespeech 0.2.0 depends on librosa==0.8.1
    spleeter 2.3.0 depends on librosa==0.8.0
jerryuhoo commented 2 years ago

要不先安装spleeter再安装paddlespeech吧，用librosa==0.8.1的版本，这两个官方发布的包用的librosa版本冲突也没办法，但是应该不会影响使用

prophesier commented 2 years ago

今天又试了一下，我发现这个安装有两个独立的错误， 其一是上面提到的依赖冲突问题， 其二是单独安装paddlespeech的时候，里面其中一个依赖项dtaidistance在build wheel的时候会报错。

先说第二点：google了一下说这个是windows的bug，尝试多种解决方法未果（包括提到好像换numpy版本可以，但是我试了依然报错），后来发现单独安装dtaidistance不会报错，猜测可能只有某个版本的dtaidistance会有问题。最后把requirements.txt里面改为了paddlespeech==0.2.0 dtaidistance>2.3.1解决了这个报错。安装可以正常安装，不过安装完之后pip提示一些jupyter的东西依赖冲突。。希望之后没事。

然后是第一点，由于spleeter的release就两个版本，另一个太老了，都不支持librosa0.8.1。所以试图找到共用的版本失败。尝试先安装spleeter再安装paddlespeech。最后用的是librosa0.8.1.事实证明这个方法不行，命令行调用spleeter会直接报错终止。 然后我采用的方法是分两个环境分别装spleeter和paddlespeech，手动进行文本前端的处理。前面都是正常的，但是用sh文件里spleeter相关的语句每次只能处理到素材的第二个片段，然后就会报错弹出（一闪而过看不清报的什么错）

坑太多实在不想去debug了，最后决定彻底放弃命令行版的spleeter，直接用spleeterGUI，gui版本是支持同时拖进去多个文件的，算是比较完美解决去背景音这一步了，也不需要搞两个环境切来切去，就去背景这步手动用gui搞一下就可以了。

prophesier commented 2 years ago

然后在2.4步的时候会报如下错误 image

jerryuhoo commented 2 years ago

https://github.com/PaddlePaddle/PaddleSpeech/issues/1617 会不会是paddlespeech 0.2.0版本没安装成功？windows安装我确实没测试过，我在linux上安装感觉坑会少一点

prophesier commented 2 years ago

看了一下，应该是paddleaudio那一部分没有安装，按照issue里面的方法去试了，结果发现就是paddleaudio依赖dtaidistance这个包，回到了前面dtaidistance==2.3.1安装不了的问题上，报错如下： ` Building wheel for dtaidistance (pyproject.toml) ... error error: subprocess-exited-with-error

× Building wheel for dtaidistance (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [248 lines of output] WARNING: Numpy was not found, preparing a version without Numpy support. running bdist_wheel running build running build_py creating build creating build\lib.win-amd64-cpython-38 creating build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\alignment.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dp.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_barycenter.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_ndim.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_ndim_visualisation.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_visualisation.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_weighted.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\ed.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\exceptions.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\preprocessing.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\util.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\util_numpy.py -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance__init.py -> build\lib.win-amd64-cpython-38\dtaidistance creating build\lib.win-amd64-cpython-38\dtaidistance\clustering copying dtaidistance\clustering\hierarchical.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering copying dtaidistance\clustering\kmeans.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering copying dtaidistance\clustering\medoids.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering copying dtaidistance\clustering\visualization.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering copying dtaidistance\clustering__init.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering creating build\lib.win-amd64-cpython-38\dtaidistance\subsequence copying dtaidistance\subsequence\dtw.py -> build\lib.win-amd64-cpython-38\dtaidistance\subsequence copying dtaidistance\subsequence\init.py -> build\lib.win-amd64-cpython-38\dtaidistance\subsequence running egg_info writing dtaidistance.egg-info\PKG-INFO writing dependency_links to dtaidistance.egg-info\dependency_links.txt writing requirements to dtaidistance.egg-info\requires.txt writing top-level names to dtaidistance.egg-info\top_level.txt reading manifest file 'dtaidistance.egg-info\SOURCES.txt' reading manifest template 'MANIFEST.in' no previously-included directories found matching 'experiments' no previously-included directories found matching 'venv' no previously-included directories found matching 'tests\pycache__' no previously-included directories found matching 'tests\output' adding license file 'LICENSE' writing manifest file 'dtaidistance.egg-info\SOURCES.txt' copying dtaidistance\dtaidistancec_dtw.pxd -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtaidistancec_dtw_omp.pxd -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtaidistancec_ed.pxd -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtaidistancec_globals.pxd -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_c.pyx -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_cc.c -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_cc.pxd -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_cc.pyx -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_cc_omp.c -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\dtw_cc_omp.pyx -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\ed_cc.c -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\ed_cc.pyx -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\util_numpy_cc.c -> build\lib.win-amd64-cpython-38\dtaidistance copying dtaidistance\util_numpy_cc.pyx -> build\lib.win-amd64-cpython-38\dtaidistance creating build\lib.win-amd64-cpython-38\dtaidistance\lib creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\Makefile -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\readme.md -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_benchmark.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.h -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.h -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.h -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.h -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_dtw.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_matrix.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\main.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.pbxproj -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\contents.xcworkspacedata -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata\IDEWorkspaceChecks.plist -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceC.xcscheme -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCBenchmark.xcscheme -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestDTW.xcscheme -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestMatrix.xcscheme -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger ERROR: The C extension could not be compiled error: could not create 'build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist': No such file or directory running bdist_wheel running build running build_py creating build\lib creating build\lib\dtaidistance copying dtaidistance\alignment.py -> build\lib\dtaidistance copying dtaidistance\dp.py -> build\lib\dtaidistance copying dtaidistance\dtw.py -> build\lib\dtaidistance copying dtaidistance\dtw_barycenter.py -> build\lib\dtaidistance copying dtaidistance\dtw_ndim.py -> build\lib\dtaidistance copying dtaidistance\dtw_ndim_visualisation.py -> build\lib\dtaidistance copying dtaidistance\dtw_visualisation.py -> build\lib\dtaidistance copying dtaidistance\dtw_weighted.py -> build\lib\dtaidistance copying dtaidistance\ed.py -> build\lib\dtaidistance copying dtaidistance\exceptions.py -> build\lib\dtaidistance copying dtaidistance\preprocessing.py -> build\lib\dtaidistance copying dtaidistance\util.py -> build\lib\dtaidistance copying dtaidistance\util_numpy.py -> build\lib\dtaidistance copying dtaidistance\init.py -> build\lib\dtaidistance creating build\lib\dtaidistance\clustering copying dtaidistance\clustering\hierarchical.py -> build\lib\dtaidistance\clustering copying dtaidistance\clustering\kmeans.py -> build\lib\dtaidistance\clustering copying dtaidistance\clustering\medoids.py -> build\lib\dtaidistance\clustering copying dtaidistance\clustering\visualization.py -> build\lib\dtaidistance\clustering copying dtaidistance\clustering\init.py -> build\lib\dtaidistance\clustering creating build\lib\dtaidistance\subsequence copying dtaidistance\subsequence\dtw.py -> build\lib\dtaidistance\subsequence copying dtaidistance\subsequence\init.py -> build\lib\dtaidistance\subsequence running egg_info writing dtaidistance.egg-info\PKG-INFO writing dependency_links to dtaidistance.egg-info\dependency_links.txt writing requirements to dtaidistance.egg-info\requires.txt writing top-level names to dtaidistance.egg-info\top_level.txt reading manifest file 'dtaidistance.egg-info\SOURCES.txt' reading manifest template 'MANIFEST.in' no previously-included directories found matching 'experiments' no previously-included directories found matching 'venv' no previously-included directories found matching 'tests\pycache' no previously-included directories found matching 'tests\output' adding license file 'LICENSE' writing manifest file 'dtaidistance.egg-info\SOURCES.txt' copying dtaidistance\dtaidistancec_dtw.pxd -> build\lib\dtaidistance copying dtaidistance\dtaidistancec_dtw_omp.pxd -> build\lib\dtaidistance copying dtaidistance\dtaidistancec_ed.pxd -> build\lib\dtaidistance copying dtaidistance\dtaidistancec_globals.pxd -> build\lib\dtaidistance copying dtaidistance\dtw_c.pyx -> build\lib\dtaidistance copying dtaidistance\dtw_cc.c -> build\lib\dtaidistance copying dtaidistance\dtw_cc.pxd -> build\lib\dtaidistance copying dtaidistance\dtw_cc.pyx -> build\lib\dtaidistance copying dtaidistance\dtw_cc_omp.c -> build\lib\dtaidistance copying dtaidistance\dtw_cc_omp.pyx -> build\lib\dtaidistance copying dtaidistance\ed_cc.c -> build\lib\dtaidistance copying dtaidistance\ed_cc.pyx -> build\lib\dtaidistance copying dtaidistance\util_numpy_cc.c -> build\lib\dtaidistance copying dtaidistance\util_numpy_cc.pyx -> build\lib\dtaidistance creating build\lib\dtaidistance\lib creating build\lib\dtaidistance\lib\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\Makefile -> build\lib\dtaidistance\lib\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\readme.md -> build\lib\dtaidistance\lib\DTAIDistanceC creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_benchmark.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.h -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.h -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.h -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.h -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_dtw.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_matrix.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\main.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.pbxproj -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\contents.xcworkspacedata -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata\IDEWorkspaceChecks.plist -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceC.xcscheme -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCBenchmark.xcscheme -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestDTW.xcscheme -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestMatrix.xcscheme -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcschemes copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcschemes\xcschememanagement.plist -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcschemes installing to build\bdist.win-amd64\wheel running install running install_lib creating build\bdist.win-amd64 creating build\bdist.win-amd64\wheel creating build\bdist.win-amd64\wheel\dtaidistance copying build\lib\dtaidistance\alignment.py -> build\bdist.win-amd64\wheel.\dtaidistance creating build\bdist.win-amd64\wheel\dtaidistance\clustering copying build\lib\dtaidistance\clustering\hierarchical.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering copying build\lib\dtaidistance\clustering\kmeans.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering copying build\lib\dtaidistance\clustering\medoids.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering copying build\lib\dtaidistance\clustering\visualization.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering copying build\lib\dtaidistance\clustering\init__.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering copying build\lib\dtaidistance\dp.py -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtaidistancec_dtw.pxd -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtaidistancec_dtw_omp.pxd -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtaidistancec_ed.pxd -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtaidistancec_globals.pxd -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw.py -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_barycenter.py -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_c.pyx -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_cc.c -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_cc.pxd -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_cc.pyx -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_cc_omp.c -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_cc_omp.pyx -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_ndim.py -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_ndim_visualisation.py -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_visualisation.py -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\dtw_weighted.py -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\ed.py -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\ed_cc.c -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\ed_cc.pyx -> build\bdist.win-amd64\wheel.\dtaidistance copying build\lib\dtaidistance\exceptions.py -> build\bdist.win-amd64\wheel.\dtaidistance creating build\bdist.win-amd64\wheel\dtaidistance\lib creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_benchmark.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.h -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.h -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.h -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.h -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_dtw.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_matrix.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\main.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.pbxproj -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\contents.xcworkspacedata -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata\IDEWorkspaceChecks.plist -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceC.xcscheme -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCBenchmark.xcscheme -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestDTW.xcscheme -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestMatrix.xcscheme -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger error: could not create 'build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist': No such file or directory [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for dtaidistance Successfully built paddleaudio Failed to build dtaidistance ERROR: Could not build wheels for dtaidistance, which is required to install pyproject.toml-based projects ` 没有查到可用的解决方法，感觉无解了。回头用linux再试试吧

prophesier commented 2 years ago

试着直接编辑了一下paddleaudio的setup.py，把对dtaidistance版本的依赖给删了，然后成功安装并进行2.4的文本生成了

prophesier commented 2 years ago

步骤2.6 data_filter.py 运行时首先报错gbk编码打不开txt文件，修改代码后报错如下：

(paddle) F:\code\VtuberTalk>python tools/data_filter.py --path F:\code\VtuberTalk\data\wav_temp\tf\split\
Traceback (most recent call last):
  File "tools/data_filter.py", line 48, in <module>
    process(args, outdir)
  File "tools/data_filter.py", line 32, in process
    move(path, file, outdir)
  File "tools/data_filter.py", line 12, in move
    os.replace(os.path.join(root_path, file_name), os.path.join(output_path, file_name))
PermissionError: [WinError 32] 另一个程序正在使用此文件，进程无法访问。: 'F:\\code\\VtuberTalk\\data\\wav_temp\\tf\\split\\tf_006_00.txt' -> 'F:\\code\\VtuberTalk\\data\\wav_temp\\tf\\split\\../useless\\tf_006_00.txt'

进程冲突，检查代码后将process这个函数改成了这样，最后成功运行

def process(args, outdir):
    path=args.path
    files=os.listdir(path)
    files = sorted_alphanumeric(files)
    count = [0] * 600
    for file in files:
        if file.endswith('.txt'):
            pass
        else:
            continue
        position = path + file
        line_len=0
        with open(position , 'r', encoding='utf-8') as f:
            for line in f.readlines():
                line_len = len(line)
                count[line_len] += 1
        if line_len < int(args.min) or line_len > int(args.max):
            move(path, file, outdir)
    for i in range(len(count)):
        print("长度为", i, "的有", count[i], "条。")

原来版本是在withopen里面直接调用move函数引起了报错

jerryuhoo commented 2 years ago

data_filter的作用是把上一步生成的txt里过长和过短的给删除，这样修改的话只能判断txt里最后一行的长度了

prophesier commented 2 years ago

emm, 因为这个filter是直接在split的目录里面找的txt文件，是还没整合过的，每个txt文件本来就只有一行，所以应该是没问题的

jerryuhoo commented 2 years ago

emm, 因为这个filter是直接在split的目录里面找的txt文件，是还没整合过的，每个txt文件本来就只有一行，所以应该是没问题的

哦对对对，太久没用了我都忘了，确实是应该只有一行的，我修改一下，应该先close文件再移动的。

prophesier commented 2 years ago

步骤2.10中，提取features过程中使用单人speedyspeech，发现运行speedyspeech下的preprocess.py报错，

from paddlespeech.t2s.data.get_feats import LogMelFBank

这句找不到对应的module 对比fastspeech2的preprocess发现需要改为

from paddlespeech.t2s.datasets.get_feats import LogMelFBank

然后正常运行

jerryuhoo commented 2 years ago

已修复

prophesier commented 2 years ago

额额好快，发现speedyspeech里面还有一些问题， 首先上面同样的引入错误也出现在am_batch_fn.py中 然后preprocess.py的252行

    elif args.dataset == "other":
        sub_num_dev = 100
        wav_dir = rootdir / "wav"
...

文件路径应该是

    elif args.dataset == "other":
        sub_num_dev = 100
        wav_dir = rootdir / "wav_temp"
...

另外normalize过程在首页的命令里面少了--speaker-dict=dump/speaker_id_map.txt这个参数，在sh文件里是正常的

prophesier commented 2 years ago

speaker_id_map这个好像是多人才需要，但是单人不加这个会报错，sh文件中即使是单人也加上了

jerryuhoo commented 2 years ago

wav_temp这个地方我应该是忘记写了，在mfa之后加一个第8步，把wav_temp/speaker/split的内容复制到wav/speaker中。之后run_train.sh里用的都是wav，wav_temp在制作数据集完成之后就可以删了。想了一下应该还是要在mfa之前做，毕竟制作数据集目前只能做处理单人的，如果要处理多人的数据集就还要再运行一遍脚本。

prophesier commented 2 years ago

好的谢谢，看了一下程序里好像也判断了要是有split文件夹就用里面的wav文件，所以我之前直接改了倒是也没出问题。 然后gui部分的话很多文件路径写死了，找不到就会闪退，比如默认的fastspeech，我模型用的是speedyspeech就会报错，这个你大概后续还会调整吧？我暂时自己改了改让它不闪退能生成语音了。想问下这个要是想训练出一个差不多还可以用的模型要大概多少原始数据，跑多少epoch呢？有没有直接拿预训练模型进行finetune的方法？

jerryuhoo commented 2 years ago

我把文档里单人的删了吧，paddlespeech可能之后改过，如果都需要speaker-dict的话单人的应该和多人的一样？

想问下这个要是想训练出一个差不多还可以用的模型要大概多少原始数据，跑多少epoch呢？有没有直接拿预训练模型进行finetune的方法？

目前按照https://github.com/jerryuhoo/VTuberTalk/issues/7 我说的方法，finetune的话我觉得起码一个人需要300句，每句长1s-3s，大概3-50个字左右都行，fastspeech batch size设置为8的情况下跑20万步以上吧，反正差不多大概收敛了就行，hifigan vocoder得finetune一下，如果从头开始训练起码40万步以上。

jerryuhoo commented 2 years ago

目前官方没有speedyspeech的多人模型，所以建议结合一下aishell3的数据集一起训练，可以先训练一个纯aishell3的多人模型，然后再把制作好的数据集替换掉某个SSB****文件夹，wav和TextGrid文件夹都要替换，然后重新run_train.sh，在normalize这步之前停一下，把phone-dict.txt替换为之前训练好的字典，而不是用刚刚生成的字典。

prophesier commented 2 years ago

好的，我再翻翻paddle仓库教程研究研究，谢谢了