RayVentura / ShortGPT

πŸš€πŸŽ¬ ShortGPT - Experimental AI framework for youtube shorts / tiktok channel automation
https://shortx.ai/?ref=sgpt
MIT License
5.82k stars 738 forks source link

Error when trying to create video #1

Closed edmundman closed 1 year ago

edmundman commented 1 year ago

Went though the "automate video with stock assests" workflow with all api keys input and after installing requirements but get this error: (base) D:\Code\ShortGPT>python runShortGPT.py Running on local URL: http://127.0.0.1:31415

To create a public link, set share=True in launch(). Step 1 _generateTempAudio 'AsyncRequest' object has no attribute '_json_response_data' Step 2 _speedUpAudio ffmpeg version 4.2.3 Copyright (c) 2000-2020 the FFmpeg developers built with gcc 9.3.1 (GCC) 20200523 configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libdav1d --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libmfx --enable-amf --enable-ffnvcodec --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt libavutil 56. 31.100 / 56. 31.100 libavcodec 58. 54.100 / 58. 54.100 libavformat 58. 29.100 / 58. 29.100 libavdevice 58. 8.100 / 58. 8.100 libavfilter 7. 57.100 / 7. 57.100 libswscale 5. 5.100 / 5. 5.100 libswresample 3. 5.100 / 3. 5.100 libpostproc 55. 5.100 / 55. 5.100 [mp3 @ 00000187d2789480] Estimating duration from bitrate, this may be inaccurate Input #0, mp3, from '.editing_assets/general_video_assets/4e0ede81afb2456a93961084/temp_audio_path.wav': Duration: 00:00:40.80, start: 0.000000, bitrate: 64 kb/s Stream #0:0: Audio: mp3, 44100 Hz, mono, fltp, 64 kb/s Stream mapping: Stream #0:0 -> #0:0 (mp3 (mp3float) -> pcm_s16le (native)) Press [q] to stop, [?] for help Output #0, wav, to '.editing_assets/general_video_assets/4e0ede81afb2456a93961084/audio_voice.wav': Metadata: ISFT : Lavf58.29.100 Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, mono, s16, 705 kb/s Metadata: encoder : Lavc58.54.100 pcm_s16le size= 3515kB time=00:00:40.80 bitrate= 705.6kbits/s speed= 376x video:0kB audio:3514kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.002167% Step 3 _timeCaptions 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 72.1M/72.1M [00:07<00:00, 10.7MiB/s] Error File "D:\Code\ShortGPT\gui\video_automation_ui.py", line 122, in respond video_path = makeVideo(script, language.value, isVertical, progress=progress) File "D:\Code\ShortGPT\gui\video_automation_ui.py", line 42, in makeVideo for step_num, step_info in shortEngine.makeShort(): File "D:\Code\ShortGPT\shortGPT\engine\abstract_content_engine.py", line 72, in makeShort self.stepDict[currentStep]() File "D:\Code\ShortGPT\shortGPT\engine\content_video_engine.py", line 69, in _timeCaptions whisper_analysis = audio_utils.audioToText(self._db_audio_path) File "D:\Code\ShortGPT\shortGPT\audio\audio_utils.py", line 60, in audioToText gen = transcribe_timestamped(WHISPER_MODEL, filename,verbose=False, fp16=False) File "C:\Users\Ed\AppData\Local\mambaforge\lib\site-packages\whisper_timestamped\transcribe.py", line 230, in transcribe_timestamped alignment_heads=get_alignment_heads(model) if word_alignement_most_top_layers is None else None, File "C:\Users\Ed\AppData\Local\mambaforge\lib\site-packages\whisper_timestamped\transcribe.py", line 2032, in get_alignment_heads return _get_alignment_heads(model_name, num_layers, num_heads) File "C:\Users\Ed\AppData\Local\mambaforge\lib\site-packages\whisper_timestamped\transcribe.py", line 2037, in _get_alignment_heads mask = torch.from_numpy(array).reshape(num_layers, num_heads)

RayVentura commented 1 year ago

Tell me if https://github.com/RayVentura/ShortGPT/issues/2 help

cian0 commented 1 year ago

Tell me if #2 help

I'm still having the same issue with that fix

ERROR : MoviePy Error: creation of None failed because of the following error: convert-im6.q16: attempt to perform an operation not allowed by the security policy @/tmp/tmp17x1nomq.txt' @ error/property.c/InterpretImageProperties/3706. convert-im6.q16: no images defined PNG32:/tmp/tmpc64bvt1o.png' @ error/convert.c/ConvertImageCommand/3229. . .This error can be due to the fact that ImageMagick is not installed on your computer, or (for Windows users) that you didn't specify the path to the ImageMagick binary in file conf.py, or that the path you specified is incorrect Traceback Info : File "./ShortGPT/gui/short_automation_ui.py", line 157, in create_short for step_num, step_info in shortEngine.makeShort(): File "./ShortGPT/shortGPT/engine/abstract_content_engine.py", line 72, in makeShort self.stepDictcurrentStep File "./ShortGPT/shortGPT/engine/reddit_short_engine.py", line 59, in _prepareCustomAssets imageEditingEngine.renderImage( File "./ShortGPT/shortGPT/editing_framework/editing_engine.py", line 95, in renderImage engine.generate_image(self.schema, outputPath) File "./ShortGPT/shortGPT/editing_framework/core_editing_engine.py", line 34, in generate_image clip = self.process_text_asset(asset) File "./ShortGPT/shortGPT/editing_framework/core_editing_engine.py", line 193, in process_text_asset clip = TextClip(**clip_info) File "/home/ian/.local/lib/python3.10/site-packages/moviepy/video/VideoClip.py", line 1146, in init raise IOError(error)

RayVentura commented 1 year ago

I think I solved that error @cian0 . Since you're on linux, please run this command, it should fix your problem, I just added it to the installation steps for linux on the README.md Uninstall imagemagick, reinstall it, run !sed -i '/<policy domain="path" rights="none" pattern="@\*"/d' /etc/ImageMagick-6/policy.xml and that should get rid of the policy error.

Then, run the code again, tell me if it persists.