Captomate: Automated Captioning Tool

NOTE: This was just a hobby project with no proper organized code structure or documentation. I am sharing it in case it might help others. I don't plan on maintaining this repository. 📝

Use 🚀

Captomate allows you to add captions on videos. It makes tiktok style captioning videos easy. 💬

You can:

Add captions on top of your own video files
Use AI to generate text to speech audio
Modify captions look as per substation alpha format

Installation 💻

This has only been tested in Ubuntu 22.04 on amd64 CPU. You can raise an issue if you find some issues and I can try to help. Open a terminal and in the root directory make install.sh and run.sh executable

chmod +x run.sh
chmod +x install.sh

After that just start the install.sh and it should create a virtual environment and auto install everything for you.

I do not have a bat file for installation on windows, so if anyone can make it, that would be awesome :)

. install.sh

You would also need to install FFMPEG on your device for this software to work.

Here's how to do it for Ubuntu Windows 🛠️

Optional

If you want demo stock footage from youtube, check out demo folder If you want different fonts for captions, install fonts from the automate fonts folder in your system.

Credits 🛠️

The tool uses a Gradio frontend. 🖥️

PywhisperCPP has been used for auto-captioning. 🤖

Silero AI handles the Text to Speech part. 🗣️

Pedalboard is for some minor audio effects. 🎶

PyonFX for generating the caption effects in substation alpha. ✨

Using the tool

. run.sh

This should start the gradio interface.

Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.

Ctrl + Click on the link or paste it in a browser. This will launch the following interface.

bhushanap / captomate