cloneofsimo / paint-with-words-sd

Implementation of Paint-with-words with Stable Diffusion : method from eDiff-I that let you generate image from text-labeled segmentation map.
MIT License
635 stars 52 forks source link

SMB World 1-1 Segmentation Map and Key. #19

Open MiLO83 opened 1 year ago

MiLO83 commented 1 year ago

0-0 (0,255,255): "Sky,1.0", (0,0,0): "Black,1.0", (1,1,1): "Cave,1.0", (5,5,5): "Green Sewer Pipe,1.0", (22,22,22): "Red Soil,1.0", (25,25,25): "Sky,1.0", (28,28,28): "Grassy Hill,1.0", (30,30,30): "Green Bush,1.0", (31,31,31): "Green,1.0", (35,35,35): "Orange Block,1.0", (37,37,37): "Orange Bricks,1.0", (53,53,53): "Castle Door,1.0", (55,55,55): "Castle,1.0", (59,59,59): "Mario Bros Question Mark Block,1.0", (64,64,64): "Fluffy Cloud,1.0", (73,73,73): "Grassy Cliff Edge,1.0",

I have written a TOOL which dissects PNG 2D videogame maps (NES, SNES, GBA, SEGA ETC) into Segmentation maps / keys for use with this REPO.

EDIT : GOT IT WORKING!

I have also heavily modified an NES Emulator and am working on loading these outputs right back INTO the games so the new graphics replace the old ones in-game.

I have all the maps for SMB1 output like this. I will post some results here in a little while. :)

mittski commented 1 year ago

When I run runner.py I get a kitten and the dog is missing :/

you have to change filenames in runner.py from example, plug in the right example to the function at the bottom of that file its still trying to run off the example images packaged with the repo