search

lastmile-ai / aiconfig

AIConfig is a config-based framework to build generative AI applications.
https://aiconfig.lastmileai.dev
MIT License
943 stars 77 forks source link

Gradio cookbook: `ffmpeg missing` error #1154

Open sp6370 opened 7 months ago

sp6370 commented 7 months ago

When running Gradio cookbook, I am running into this error when trying to execute the very last prompt in the cookbook.

Error message shown in the editor: Error Exception: ffmpeg was not found but is required to load audio files from filename

Logs:

[INFO] 2024-02-06 20:38:41,093 callback.py:146: Callback called. event
: name='on_deserialize_start' file='aiconfig_extension_hugging_face.local_inference.automatic_speech_recognition' data={'prompt': Prompt(name='asr', input=PromptInput(attachments=[Attachment(data=AttachmentDataWithStringValue(kind='file_uri', value='https://s3.amazonaws.com/lastmileai.aiconfig.public/uploads/2024_1_16_20_21_10/1673/hi (1).mp3'), mime_type='audio/mpeg', metadata=None)], data=None), metadata=PromptMetadata(model=ModelMetadata(name='HuggingFaceAutomaticSpeechRecognitionTransformer', settings={'model': 'openai/whisper-small'}), tags=None, parameters={}), outputs=None), 'params': {}} ts_ns=1707269505283627714
[INFO] 2024-02-06 20:38:41,093 callback.py:146: Callback called. event
: name='on_deserialize_complete' file='aiconfig_extension_hugging_face.local_inference.automatic_speech_recognition' data={'output': {'inputs': ['https://s3.amazonaws.com/lastmileai.aiconfig.public/uploads/2024_1_16_20_21_10/1673/hi (1).mp3']}} ts_ns=1707269505283627714
Output queue is currently empty. Waiting for 29.7s...
Output queue is currently empty. Waiting for 29.8s...
Output queue is currently empty. Waiting for 29.9s...
[INFO] 2024-02-06 20:38:53,237 server.py:527: Running `aiconfig.run()` command with request: {'prompt_name': 'asr', 'stream': True, 'cancellation_token_id': '644356ca-5b4f-4ebe-9196-192047036ffc'}
[INFO] 2024-02-06 20:38:53,238 callback.py:146: Callback called. event
: name='on_run_start' file='aiconfig.Config' data={'prompt_name': 'asr', 'params': {}, 'options': <aiconfig.model_parser.InferenceOptions object at 0x77957327caa0>, 'kwargs': {'run_with_dependencies': False}} ts_ns=1707269505283627714
[INFO] 2024-02-06 20:38:53,238 callback.py:146: Callback called. event
: name='on_run_start' file='aiconfig_extension_hugging_face.local_inference.automatic_speech_recognition' data={'prompt': Prompt(name='asr', input=PromptInput(attachments=[Attachment(data=AttachmentDataWithStringValue(kind='file_uri', value='https://s3.amazonaws.com/lastmileai.aiconfig.public/uploads/2024_1_16_20_21_10/1673/hi (1).mp3'), mime_type='audio/mpeg', metadata=None)], data=None), metadata=PromptMetadata(model=ModelMetadata(name='HuggingFaceAutomaticSpeechRecognitionTransformer', settings={'model': 'openai/whisper-small'}), tags=None, parameters={}), outputs=None), 'options': <aiconfig.model_parser.InferenceOptions object at 0x77957327caa0>, 'parameters': {}} ts_ns=1707269505283627714
[INFO] 2024-02-06 20:38:53,239 callback.py:146: Callback called. event
: name='on_deserialize_start' file='aiconfig_extension_hugging_face.local_inference.automatic_speech_recognition' data={'prompt': Prompt(name='asr', input=PromptInput(attachments=[Attachment(data=AttachmentDataWithStringValue(kind='file_uri', value='https://s3.amazonaws.com/lastmileai.aiconfig.public/uploads/2024_1_16_20_21_10/1673/hi (1).mp3'), mime_type='audio/mpeg', metadata=None)], data=None), metadata=PromptMetadata(model=ModelMetadata(name='HuggingFaceAutomaticSpeechRecognitionTransformer', settings={'model': 'openai/whisper-small'}), tags=None, parameters={}), outputs=None), 'params': {}} ts_ns=1707269505283627714
[INFO] 2024-02-06 20:38:53,239 callback.py:146: Callback called. event
: name='on_deserialize_complete' file='aiconfig_extension_hugging_face.local_inference.automatic_speech_recognition' data={'output': {'inputs': ['https://s3.amazonaws.com/lastmileai.aiconfig.public/uploads/2024_1_16_20_21_10/1673/hi (1).mp3']}} ts_ns=1707269505283627714
Output queue is currently empty. Waiting for 0.1s...
Output queue is currently empty. Waiting for 0.2s...
Output queue is currently empty. Waiting for 0.3s...
[INFO] 2024-02-06 20:38:56,455 server.py:257: No path provided, saving to original path, /home/sp/Github/forks/aiconfig/cookbooks/Gradio/huggingface.aiconfig.json
[INFO] 2024-02-06 20:38:56,455 server_utils.py:416: About to run operation: save, res_op_args=Ok({'config_filepath': '/home/sp/Github/forks/aiconfig/cookbooks/Gradio/huggingface.aiconfig.json'})
[INFO] 2024-02-06 20:38:56,455 server_utils.py:391: Running method: save, operation_args={'config_filepath': '/home/sp/Github/forks/aiconfig/cookbooks/Gradio/huggingface.aiconfig.json'}
[INFO] 2024-02-06 20:38:56,456 server_utils.py:367: Method result (save): None
[INFO] 2024-02-06 20:38:56,456 server_utils.py:423: res_run=Ok(None)
[INFO] 2024-02-06 20:39:00,767 server.py:527: Running `aiconfig.run()` command with request: {'prompt_name': 'asr', 'stream': True, 'cancellation_token_id': 'b1c188b9-66bb-427b-9dd8-58bf8a6dfffa'}
[INFO] 2024-02-06 20:39:00,768 callback.py:146: Callback called. event
: name='on_run_start' file='aiconfig.Config' data={'prompt_name': 'asr', 'params': {}, 'options': <aiconfig.model_parser.InferenceOptions object at 0x779553275d30>, 'kwargs': {'run_with_dependencies': False}} ts_ns=1707269505283627714
[INFO] 2024-02-06 20:39:00,768 callback.py:146: Callback called. event
: name='on_run_start' file='aiconfig_extension_hugging_face.local_inference.automatic_speech_recognition' data={'prompt': Prompt(name='asr', input=PromptInput(attachments=[Attachment(data=AttachmentDataWithStringValue(kind='file_uri', value='https://s3.amazonaws.com/lastmileai.aiconfig.public/uploads/2024_1_16_20_21_10/1673/hi (1).mp3'), mime_type='audio/mpeg', metadata=None)], data=None), metadata=PromptMetadata(model=ModelMetadata(name='HuggingFaceAutomaticSpeechRecognitionTransformer', settings={'model': 'openai/whisper-small'}), tags=None, parameters={}), outputs=None), 'options': <aiconfig.model_parser.InferenceOptions object at 0x779553275d30>, 'parameters': {}} ts_ns=1707269505283627714
[INFO] 2024-02-06 20:39:00,768 callback.py:146: Callback called. event
: name='on_deserialize_start' file='aiconfig_extension_hugging_face.local_inference.automatic_speech_recognition' data={'prompt': Prompt(name='asr', input=PromptInput(attachments=[Attachment(data=AttachmentDataWithStringValue(kind='file_uri', value='https://s3.amazonaws.com/lastmileai.aiconfig.public/uploads/2024_1_16_20_21_10/1673/hi (1).mp3'), mime_type='audio/mpeg', metadata=None)], data=None), metadata=PromptMetadata(model=ModelMetadata(name='HuggingFaceAutomaticSpeechRecognitionTransformer', settings={'model': 'openai/whisper-small'}), tags=None, parameters={}), outputs=None), 'params': {}} ts_ns=1707269505283627714
[INFO] 2024-02-06 20:39:00,768 callback.py:146: Callback called. event
: name='on_deserialize_complete' file='aiconfig_extension_hugging_face.local_inference.automatic_speech_recognition' data={'output': {'inputs': ['https://s3.amazonaws.com/lastmileai.aiconfig.public/uploads/2024_1_16_20_21_10/1673/hi (1).mp3']}} ts_ns=1707269505283627714
Output queue is currently empty. Waiting for 0.1s...
Output queue is currently empty. Waiting for 0.2s...
Output queue is currently empty. Waiting for 0.3s...
[INFO] 2024-02-06 20:39:16,693 server.py:257: No path provided, saving to original path, /home/sp/Github/forks/aiconfig/cookbooks/Gradio/huggingface.aiconfig.json
[INFO] 2024-02-06 20:39:16,693 server_utils.py:416: About to run operation: save, res_op_args=Ok({'config_filepath': '/home/sp/Github/forks/aiconfig/cookbooks/Gradio/huggingface.aiconfig.json'})
[INFO] 2024-02-06 20:39:16,693 server_utils.py:391: Running method: save, operation_args={'config_filepath': '/home/sp/Github/forks/aiconfig/cookbooks/Gradio/huggingface.aiconfig.json'}
[INFO] 2024-02-06 20:39:16,693 server_utils.py:367: Method result (save): None
[INFO] 2024-02-06 20:39:16,693 server_utils.py:423: res_run=Ok(None)

image

rossdanlm commented 7 months ago

Thanks for sharing Sudhanshu, will add this to our critical priorities!

rossdanlm commented 6 months ago

Followups: Probably just need to add this dependency to the Gradio cookbook + HF extension