endernewton / iter-reason

Code for Iterative Reasoning Paper (CVPR 2018)
MIT License
265 stars 37 forks source link

Release the graph-based module ? #7

Open DebangLi opened 6 years ago

DebangLi commented 6 years ago

@endernewton Hi, xinlei. I like your paper very much, but I have some confusion about the graph based reasoning? Could you release the graph-based global reasoning code?

endernewton commented 6 years ago

yep, we will release the spatial relationships part in the next month or so. :)

usernameexists1016 commented 6 years ago

@endernewton Hi, Xinlei, I also would like to clarify the graph-based global reasoning. Look forward to your releasing of this module code. Thanks :)

jhneo commented 6 years ago

@endernewton I'm also looking forward to the part of global reasoning with knowledge graph

ruotianluo commented 5 years ago

following up.

mbuet2ner commented 5 years ago

@endernewton just a follow up on the requests. I am really interested in your implementation as it is very relevant for my thesis. Thanks :)

See also #10 #6

endernewton commented 5 years ago

Sorry about the real delay on this, as I really need to come back to do this but haven't got time to (essentially go back to TF as I am mostly using C2/PT now). I am first sharing the raw code (dropbox links) from previous implementations here as they are not working on my recently installed TF, and help (if someone can) to incorporate them to the main code would be appreciated.

https://www.dropbox.com/s/b15qdzpevbj12o4/gattend_memory.py?dl=0 https://www.dropbox.com/s/cwnd4wto1iil1ms/gbase_memory.py?dl=0 https://www.dropbox.com/s/9c71yp8g717w2be/snippets.py?dl=0

ZhangLin-PKU commented 5 years ago

Does anyone complete the incorporation?

ZhangLin-PKU commented 5 years ago

@endernewton hi, can you provide the config.py corresponding to the new graph version (which includes the GRA variable)? Thanks a lot for you help :)

JeremyYR commented 5 years ago

I can try it. But utils.snippets.build_region_graph, normalize and config are needed, can you share them?

ZhangLin-PKU commented 5 years ago

@JeremyYR The build_region_graph and normalize functions are already included in the latest snippets.py the author released (https://www.dropbox.com/s/9c71yp8g717w2be/snippets.py?dl=0). I tried to rewrite the config.py to contain the GRA variable, here is the code config.py.

All attributes of GRA in gattend_memory.py and gbase_memory.py are added, in the mean time three MEM attributes CC, SAT and INPUT which are new MEM attributes are also added. The MEM.ITER is changes to 3 as declared in section 4.3. I have written all comments of these attributes which explain their meanings and functions. Please note that the GRA.W_B for vg dataset is not contained, but it corresponds to the top 10 most frequent relationships as explained in section 4.1.

I hope this can help you. If you have any new progress, please tell me. Thanks a lot!

JeremyYR commented 5 years ago

@Irene-software Thanks a lot. I will :)

mjantoun commented 4 years ago

Where did you get the ade-vec.pkl file from? When I downloaded the ADE dataset I only got index_ade20k.mat file.

Circle-Liu commented 3 years ago

gbase_memory.py(https://www.dropbox.com/s/cwnd4wto1iil1ms/gbase_memory.py?dl=0)include two *.csv files which are 'data/vg-graph/%s.csv' and 'data/ade-graph/%s.csv'. and where can I find them?