I think it can be helpful to organize papers under task-oriented and chit-chat like you do now, but I think it can be better if we'll use Tags rather than categories for describing additional information. This is because a paper can have multiple contributions to it and to describe it under only one roof can be limiting. So maybe a paper could be tagged by "GAN, Hierarchical Structure, Discrete Latents, Transformer, etc..." This way we could break models by components which might help us understand how different components work with each other and also it will allow to search for a particular interest of a model. I don't know how we can implement such a thing but I think I saw something like that on Github before.
Papers:
Suggestion for this repo: