Reverts EleutherAI/elk#184. We should have this functionality in some form but I don't think we should be writing new templates to disk inside elk elicit. These are just conceptually pretty different things and clutters the elicit command too much. Some options:
Make people "manually" create the combined template separately in a console or something
Include some separate script or whatever to do this
Include a flag to combine the templates, but don't write them to disk, instead add some extra functionality to DatasetTemplates so that it can just merge these things together itself in-memory
Reverts EleutherAI/elk#184. We should have this functionality in some form but I don't think we should be writing new templates to disk inside
elk elicit
. These are just conceptually pretty different things and clutters theelicit
command too much. Some options:I think I prefer (3) but I'm open to suggestions.