wladradchenko / wunjo.wladradchenko.ru

Wunjo CE: Face Swap, Lip Sync, Control Remove Objects & Text & Background, Restyling, Audio Separator, Clone Voice, Video Generation. Open Source, Local & Free.
https://wunjo.online
MIT License
883 stars 95 forks source link
controlnet deepfake diffusion-models face-animation face-swap free img2video lip-sync photo-editing public-api remove-background remover restyle segment-anything txt2video video-editing video-generation voice-clone wunjo

Price Python 3.10 GitHub package version License: MIT v1.0 Dev.to Articles YouTube Chanel Hugging Face Models

[RU v2.0]


Logo

Wunjo Community Edition (CE)

Documentation
Issue · Discussions · Tutorial

🚀 New November Update v2.0.4 of Wunjo Pro! 🚀

Exciting news—Animate Portrait Mode and Retarget Portrait will be available on November! 🎉 With this feature, you can easily copy head movements and facial expressions from a video or image and apply them to your content. Whether it's controlling how the mouth moves, how the eyes blink, or even turning the head, you now have full control over your deepfake creation! Want more realism? You can manually add blinks, head turns, or any emotion to your videos or images after face replacement. Plus, it tracks the selected person even if they temporarily leave the frame!

🌟 Exclusive in Wunjo Pro 🌟

But here's the dream: Once we reach 4,096 stars on GitHub, I will release Wunjo Pro as an update to Wunjo Community Edition—completely open-source and fully functional offline! ✨

Wunjo is installed locally on your computer, so you can access it from any device by creating a temporary link.

Your support means everything! ⭐ Give the project a star on GitHub to help make this dream a reality!

Big update Wunjo CE v2.0.3

Video generation here!

Hey there! Your support means the world to me and is crucial in accelerating the release of new updates for the Community Edition (CE). Your encouragement and stars drives me to enhance features. And now video generation from text or image in CE with difference aspect ratio before 4 seconds with 24 FPS (or more duration with low FPS).

Also text to image, inpaint and outpaint image for video generation. Control restyling? Now you can change objects, gender and nationality of a person not just in one click, but also control the process in advance. And you only need 8 GB VRAM for this. (You can use any Stable Diffusion model v1.5, see GitHub Wiki)

Available now

Professional (Pro) version available on wunjo.online to download. Community Edition (CE) available on GitHub with voting for features to migrate on Boosty.

And if you wanna help to project, you can do:

What is update? Open this list to see full review on YouTube.
Review
video

About

Wunjo harnesses the power of neural networks to provide cutting-edge solutions in speech synthesis, voice cloning, content restyling, and deepfake animations. Official website wunjo.online.

Try it now
video
Open list to see more details. The new version 2.0 introduces a completely redesigned interface, enhanced performance, improved face swap functionality, a generator for non-existent people’s faces, and a deepfake analyzer. It also includes improvements in lip sync, content enhancement, object, text, and background removal, as well as content and component restyling using text prompts. Additionally, public links enable community creation and collaboration. For audio you will able to use improved audio separator and clone voice on any language from text and audio. Available as both a free Community Edition and a subscription-based Professional Edition on wunjo.online, Wunjo caters to a wide range of users, from beginners to professionals, ensuring privacy by operating locally on your device. **Why Choose Wunjo Community Edition?** - **All-in-One:** A comprehensive tool catering to both your voice and visual AI needs. - **User-friendly:** Designed for all, from beginners to professionals. - **Privacy First:** Functions locally on your desktop, ensuring your data remains private. - **Open-source & Free:** Benefit from community-driven enhancements and enjoy the app without any cost. **Why Choose Wunjo Professional?** - **More features:** First access to updates, additional and more advanced features ad restyling and clone voice. - **Public links:** Host your own server (PC) application accessible from anywhere in the world. - **Unlimited performance:** Process multiple tasks simultaneously to increase overall productivity. Step into the future of AI-powered creativity with Wunjo.

Setup

Requirements Python version 3.10 and ffmpeg. For GPU it is necessary to install CUDA on Nvidia processors.

For detailed instructions about setup Wunjo CE from GitHub, refer to the Launch Project from GitHub section in our wiki.

How build from code on Windows?
video

You will find on wunjo.online official installers on Wundows/Ubuntu.

⚠️ Run GPU on AMD ⚠️ You can use the GPU processor on AMD too, if you managed to install [ZLUDA](https://github.com/vosen/ZLUDA). You also need to install `firmware-linux-nonfree` package to GPU became available [Issue 72](https://github.com/wladradchenko/wunjo.wladradchenko.ru/issues/72). ``` sudo apt update sudo apt install firmware-linux-nonfree cd wunjo.wladradchenko.ru python3.10 -m venv venv source venv/bin/activate python -m pip install -r requirements_zluda.txt python -m pip install -U torch torchaudio torchvision --extra-index-url https://download.pytorch.org/whl/rocm6.1 python -m pip install -U xformers --extra-index-url https://download.pytorch.org/whl/rocm6.1 cd portable briefcase dev ``` More details in [Issue 65](https://github.com/wladradchenko/wunjo.wladradchenko.ru/issues/65) and its continuation [Issue 68](https://github.com/wladradchenko/wunjo.wladradchenko.ru/issues/68).

Updates

Update 2.0.0 - [x] Completely redesigned interface for desktop and mobile devices, from ground zero. - [x] Enhanced performance with simultaneous task handling, stability, and faster processing. - [x] Improved face swap functionality now supports multiple face swap at different timings via API. - [x] Introducing generator of non-existent people face. - [x] Deepfake analyzer added to discern authentic content from manipulated media. - [x] Enhanced lip sync for smoother animations and elimination of chin defects. - [x] Real-time mask selection for seamless editing experience. - [x] Added select area to remove text. - [x] Separated tasks for object removal and background elimination for greater precision. Now you can create chroma key video. - [x] Custom file manager introduced for efficient file management within the application. - [x] Improved interaction with neural network models, including seamless downloading from the internet. - [x] Easy switch from client to server application and back. - [x] Multi-user support with customizable limits on simultaneous tasks and memory usage (RAM, VRAM, duration, size, number at the same time task). - [x] Internal tips provided for optimizing content quality. - [x] Smart generator of prompts for video and object restyling.
Update 2.0.1 - [x] Fix bugs.
Update 2.0.2 - [x] Added functionality to clone voice in any language from text and audio. - [x] Improved audio separator to remove noise before clone voice. - [x] Enhanced processing speed.
Update 2.0.3 - [x] Added control restyling (This work with 8 GB VRAM). - [x] Added generation text-to-video, image-to-video, text-to-image, outpaint and inpaint image. - [x] Improved quality of restyling.
List features updates - [ ] Public link exchange for online users. - [ ] Multi language interface. - [ ] Improve user profile. - [ ] Improve processing content status. - [ ] Sound generation for video or from text.

Support the Project

You can support the author of the project in the development of his creative ideas on Boosty or CloudTips. Thanks to Boosty, you will have the opportunity to use your voice to choose which functions from the Professional version will appear in the Community Edition in new updates. There are other ways to support the development of the project, more details on page.

Boosty CloudTips
pizza coffee

Supporters and Donors

I extend heartfelt gratitude to the following individuals who have generously supported this project through donations:

I sincerely appreciate the generosity of all project supporters. Your contributions enable me to continue improving and maintaining this project.

Contact

Owner: Wladislav Radchenko

Email: i@wladradchenko.ru

Project: https://github.com/wladradchenko/wunjo.wladradchenko.ru

Web site: wunjo.online

Premise

Wunjo comes from the ancient runic alphabet and represents joy and contentment, which could tie into the idea of using the application to create engaging and expressive speech. Vunyo (ᚹ) is the eighth rune of the Elder and Anglo-Saxon Futhark. Prior to the introduction of the letter W into the Latin alphabet, the letter Ƿynn (Ƿƿ) was used instead in English, derived from this rune.

Credits

Wunjo is built upon the remarkable work of various open-source projects. Each integrated component reflects a commitment to improving and adapting existing technologies within the collaborative landscape of open-source development. The list below highlights the projects that have been adapted and enhanced for inclusion in Wunjo:

I extend my deepest gratitude to the original contributors of these technologies. Their groundbreaking work has been instrumental in advancing the capabilities of Wunjo CE. For the persistent storage and versioning of the models I have personally trained, I utilize the Hugging Face Model Storage. If you're interested in contributing to Wunjo CE, especially in the area of voice cloning for new languages, please feel free to propose your models or reach out for collaboration via GitHub Discussions or the Hugging Face.

[to top]