search

cc-ai / climategan

Code and pre-trained model for the algorithm generating visualisations of 3 climate change related events: floods, wildfires and smog.
https://thisclimatedoesnotexist.com
GNU General Public License v3.0
72 stars 18 forks source link

Try Advent v2 #130

Closed sashavor closed 3 years ago

sashavor commented 3 years ago

See if it helps improve results

vict0rsch commented 3 years ago

@tianyu-z can you share your results / findings / insights and general updates here?

tianyu-z commented 3 years ago

It helps but needs a little bit of modification (what I called V2.1).

12 AdventV2.1 vs #12 AdventV1 [link]

Conclusion after eyeballing:

  1. AdventV2.1 tends to flood less on some of the streetview data
  2. AdventV2.1 solved random lines issues
  3. AdventV2.1 is sensitive to shadows
  4. AdventV2.1 solved sky_ground issues (which is very serious in AdventV2)
  5. AdventV2.1 solved water_on_the_top_of_cars issues

I think for simple cases, the improvement is significant but it does not perform well on some of the Streetview (complex) cases. P.S. AdventV2 dropped Sim data for the second stage while AdventV2.1 kept a part of / all of the Sim data.

Example for 1: image Example for 2 (left is V2.1 and right is V1): image image image Example for 4: image

More experiments are on the way. I will post them here when they are ready.

tianyu-z commented 3 years ago

https://github.com/cc-ai/omnigan/pull/137

tianyu-z commented 3 years ago

To my surprise, I tried entropy_split = 0.30, 035, 0.40, 0.45, 0.50, 0.55, 0.60, 0.67, 0.75, 0.80, 0.85, 0.90, however the 0.67 one which is proposed by the original adventv2 paper has the best performance.

The train and eval links of these exps are here: https://docs.google.com/spreadsheets/d/1oaXsUeICfhmsbikVOUq0jxLr6th_6j0KpOL2UmmAqpc/edit#gid=0

Google Sheets - create and edit spreadsheets online, for free.
Create a new spreadsheet and edit with others at the same time -- from your computer, phone or tablet. Get stuff done with or without an internet connection. Use Sheets to edit Excel files. Free from Google.