search

google-research / big_vision

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.
Apache License 2.0
2.16k stars 147 forks source link

Colorization uvim model not working #19

Open muhammad-ahmed-ghani opened 1 year ago

muhammad-ahmed-ghani commented 1 year ago

Hi @andresusanopinto I hope you are well. I tried using the colorization model on my images but out of 4 it colorized only 1 image and the result is also not good at all. Can you please tell me what I am missing ? image

akolesnikoff commented 1 year ago

Hi @muhammad-ahmed-ghani,

To get colorful samples please set the sampling temperature to 1.0 in the last cell of the colab: temperature = jnp.array(1.0). After fixing the temperature also consider running inference multiple times and then selecting the best colorization attempt. The near zero sampling temperature is not good default for the colorization task, we will likely update the colab soon.

Let us know whether it worked for you.

muhammad-ahmed-ghani commented 1 year ago

I changed it but still it adds a slight blueish tint to the images. image

akolesnikoff commented 1 year ago

That is a bit puzzling, as I am able to get reasonable colorization. If you share a reproduction I may have a look at some point.

muhammad-ahmed-ghani commented 1 year ago

That is a bit puzzling, as I am able to get reasonable colorization. If you share a reproduction I may have a look at some point.

You can check the code here. I just changed the images directories.

https://colab.research.google.com/drive/1E5R_pla2cPkwVKxu9cCgvCt9PtAA-PCq?usp=sharing

muhammad-ahmed-ghani commented 1 year ago

That is a bit puzzling, as I am able to get reasonable colorization. If you share a reproduction I may have a look at some point.

You can check the code here. I just changed the images directories.

https://colab.research.google.com/drive/1E5R_pla2cPkwVKxu9cCgvCt9PtAA-PCq?usp=sharing

Hi @akolesnikoff, have you find anything on it ?