search

allenai / deep_qa

A deep NLP library, based on Keras / tf, focused on question answering (but useful for other NLP too)
Apache License 2.0
404 stars 133 forks source link

Provide an easy model ensembling API #306

Closed matt-gardner closed 7 years ago

matt-gardner commented 7 years ago

Not sure what this looks like, exactly, but it should be doable without much work.

matt-gardner commented 7 years ago

This should just require adding a new class, Ensembler, and a script to run it. The constructor takes a list of model config files (or param objects), loads all of the models, evaluates all of them on some dataset, and combines the results. This should be pretty simple.

matt-gardner commented 7 years ago

I'm starting on this now.

matt-gardner commented 7 years ago

The initial implementation of this is in and working, but it could be much cleaner and more extensible. That's a new, lower-priority issue, though, so I'm closing this one.