Music-and-Culture-Technology-Lab / omnizart

Omniscient Mozart, being able to transcribe everything in the music, including vocal, drum, chord, beat, instruments, and more.
https://music-and-culture-technology-lab.github.io/omnizart-doc/
MIT License
1.63k stars 99 forks source link

Getting issue when try to run omnizart chord transcribe <wav_file.wav> #109

Closed FawzanIF closed 8 months ago

FawzanIF commented 8 months ago

i'm trying to use omnizart on my python virtual environtment for chord transcribe. but here's what i got when i run omnizart chord transcribe wav_file.wav :

2024-02-15 14:28:23 Extracting feature 2024-02-15 14:28:26 Loading model 2024-02-15 14:28:26 Using built-in model d:\lagoe\omnizart\myenv\lib\site-packages\omnizart\checkpoints/chord/chord_v1 for transcription. WARNING:absl:Importing a function (inference_encoder_layer_call_and_return_conditional_losses_19575) with ops with custom gradients. Will likely fail if a gradient is requested. WARNING:absl:Importing a function (inference_encoder_layer_call_and_return_conditional_losses_21695) with ops with custom gradients. Will likely fail if a gradient is requested. WARNING:absl:Importing a function (inference_encoder_layer_call_and_return_conditional_losses_76469) with ops with custom gradients. Will likely fail if a gradient is requested. WARNING:absl:Importing a function (inference_encoder_layer_call_and_return_conditional_losses_74349) with ops with custom gradients. Will likely fail if a gradient is requested. WARNING:absl:Importing a function (inference_chord_model_layer_call_and_return_conditional_losses_63102) with ops with custom gradients. Will likely fail if a gradient is requested. WARNING:absl:Importing a function (__inference_chord_model_layer_call_and_return_conditional_losses_45289) with ops with custom gradients. Will likely fail if a gradient is requested. WARNING:absl:Importing a function (inference_chord_model_layer_call_and_return_conditional_losses_71739) with ops with custom gradients. Will likely fail if a gradient is requested. WARNING:absl:Importing a function (inference_chord_model_layer_call_and_return_conditional_losses_53926) with ops with custom gradients. Will likely fail if a gradient is requested. WARNING:absl:Importing a function (inferencewrapped_model_17395) with ops with custom gradients. Will likely fail if a gradient is requested. 2024-02-15 14:28:53 Preparing feature for model prediction INFO:Chord Application:Preparing feature for model prediction 2024-02-15 14:28:53 Predicting... INFO:Chord Application:Predicting... Traceback (most recent call last): File "C:\Users\fawza\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\fawza\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 87, in _run_code exec(code, run_globals) File "D:\LAGOE\omnizart\myenv\Scripts\omnizart.exe__main.py", line 7, in File "d:\lagoe\omnizart\myenv\lib\site-packages\click\core.py", line 829, in call__ return self.main(args, kwargs) File "d:\lagoe\omnizart\myenv\lib\site-packages\click\core.py", line 782, in main rv = self.invoke(ctx) File "d:\lagoe\omnizart\myenv\lib\site-packages\click\core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "d:\lagoe\omnizart\myenv\lib\site-packages\click\core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "d:\lagoe\omnizart\myenv\lib\site-packages\click\core.py", line 1066, in invoke return ctx.invoke(self.callback, ctx.params) File "d:\lagoe\omnizart\myenv\lib\site-packages\click\core.py", line 610, in invoke return callback(args, **kwargs) File "d:\lagoe\omnizart\myenv\lib\site-packages\omnizart\cli\chord\transcribe.py", line 16, in transcribe chord.app.transcribe(input_audio, model_path=modelpath, output=output) File "d:\lagoe\omnizart\myenv\lib\site-packages\omnizart\chord\app.py", line 81, in transcribe chord, , , = model.predict(segments_pad) File "d:\lagoe\omnizart\myenv\lib\site-packages\tensorflow\python\keras\engine\training.py", line 1727, in predict tmp_batch_outputs = self.predict_function(iterator) File "d:\lagoe\omnizart\myenv\lib\site-packages\tensorflow\python\eager\def_function.py", line 889, in call__ result = self._call(*args, **kwds) File "d:\lagoe\omnizart\myenv\lib\site-packages\tensorflow\python\eager\def_function.py", line 956, in _call outputs = execute.execute( File "d:\lagoe\omnizart\myenv\lib\site-packages\tensorflow\python\eager\execute.py", line 59, in in _call_flat quick_execute tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name, n call tensorflow.python.framework.errors_impl.InternalError: 2 root error(s) found. (0) Internal: cuDNN launch failure : input shape ([1,67200,24,1]) quick_execute [[{{node chord_model/StatefulPartitionedCall/StatefulPartitionedCall/encoder/encode_segment_time/multi_head_attention/layer_normalization/FusedBatchNormV3}}]] [[chord_model/StatefulPartitionedCall/StatefulPartitionedCall/decoder/map_1/while/body/_254/decoder/map_1/while/TensorArrayV2Read_1/TensorListGetItem/_154]] t_time/multi_head_attention/layer_normalization/FusedBatchNormV3}}]] (1) Internal: cuDNN launch failure : input shape ([1,67200,24,1]) 4/decoder/map_1/while/TensorArrayV2Read_1/TensorListGetItem/_154]] [[{{node chord_model/StatefulPartitionedCall/StatefulPartitionedCall/encoder/encode_segment_time/multi_head_attention/layer_normalization/FusedBatchNormV3}}]] t_time/multi_head_attention/layer_normalization/FusedBatchNormV3}}]] 0 successful operations. 0 derived errors ignored. [Op:__inference_predict_function_82382]

Function call stack: predict_function -> predict_function

can anyone help me to find solution for this issue? thanks