search

lucidrains / deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
MIT License
4.37k stars 327 forks source link

🥰 Pleasant Spring Grand Piano Story 🥰 #106

Open asigalov61 opened 3 years ago

asigalov61 commented 3 years ago

Hey deep-daze fans and devs,

I just wanted to share with you my little creation.

https://www.youtube.com/watch?v=1uyZhnQoTIc

This was made with deep-daze and my Optimus-Virtuoso in about 4 hours from scratch and just from the following 5 words:

🥰 Pleasant Spring Grand Piano Story 🥰

Absolutely amazing!

This is raw video and audio without any mods or post-production. Not cherry-picked, although I did a few runs on each to be fair.

I will update a link shortly with all source multimedia files just in case someone wants it.

I guess all we gotta wait for is the 3D projections and we will be able to put together a nice Projected Reality 🥰 (aka Holodeck)

Any feedback, good or bad would be tremendously appreciated.

Thanks.

Alex

Fliens commented 3 years ago

You could even improve it with the new added --story_separator With it, you could make the transitions more fluid :)

asigalov61 commented 3 years ago

@Fliens Thanks. That is the plan. I am trying to put together a nice implementation of a deep-daze + music generator so that it would be possible to easily create movies like that. Holodeck, here we come! :)

Fliens commented 3 years ago

@asigalov61 Making music videos is great I made some but due to copyright i can't put audio on them With audio you could even better understand what is currently being imagined

Break my stride

Walking on a dream

Mary had a little lamb <- a bit horrifying xD

I used the complete lyrics on Mary had a little lamb but for the other two I only used the chorus

asigalov61 commented 3 years ago

@Fliens Very nice :) Thank you for sharing. I liked and subbed.

Yes, this is why I added music to mine because it makes it much more immersive. In fact, this greatly reminds me of the first silent movies era when they also started with videos, then added music, and only then voice and sfxs.

Good job! :)