Open dvsrepo opened 2 months ago
Yes, I think it makes sense to have these sensible defaults. Something related I was thinking is to also have auxiliary functions that creates several steps, kind of syntactic sugar:
def generate_with(models: List[str]): ...
with Pipeline(name="my-pipe") as pipeline:
load_data = ...
load_data >> generate_with(["llama3", "mistral", "gpt4"])
but not 100% sure about it because it can hide many details and make the user confuse
[Updated: Added suggestion 2. for Ultrafeedback] This is an issue to discuss the defaults for (some) Steps and Task.
The main idea is to think about the most frequent uses and paths for certain components. I'll start:
CombineColumns
: In my experience, the most likely usage of this is after several generation steps (which by default outputgeneration
andmodel_name
). Would it make sense to set this as default values forcolumns
. This could allow to go from:to
text_generation >> CombineColumns()