facebookresearch / clutrr

Diagnostic benchmark suite to explicitly test logical relational reasoning on natural language
Other
90 stars 14 forks source link

[META] Revamp - move graph generation logic to GLC #9

Closed koustuvsinha closed 1 year ago

koustuvsinha commented 3 years ago

Confession time! I have not been able to keep up with the issues in this repository owing to my own commitments to other projects, covid isolation, among other things. However, I don't want to bore you with excuses anymore! In the last cycle, we developed GraphLog, which inherently follows the same graph generation pipeline and is under use by our lab for several projects. Gaining insights from GraphLog generation, and the follow-up works, I have been able to improve the core graph generation logic to be faster, provable, and reproducible.

I have released the core logic in a separate repo, GLC, to continue its development separately. In the coming week, I plan to integrate GLC with CLUTRR, which would hopefully resolve several issues I have received both through Github and mail about the slow and unreliable generation pipeline. Thank you for your patience and please let me know any features you want through the issues!

koustuvsinha commented 3 years ago

GLC integration is being added in the develop branch.

koustuvsinha commented 1 year ago

GLC is now integrated to the develop branch.