search

wildlife-dynamics / ecoscope-workflows

An extensible task specification and compiler for local and distributed workflows.
BSD 3-Clause "New" or "Revised" License
0 stars 1 forks source link

ETL - Color Mapping #37

Closed Yun-Wu closed 6 days ago

Yun-Wu commented 1 week ago

#35

cisaacstern commented 1 week ago

@Yun-Wu and @walljcg I'm curious what you'd think about categorizing this task, as well as #36, under tasks/preprocessing?

Is there some sense that I'm missing in which "transformation" is different than "preprocessing?

Yun-Wu commented 1 week ago

I assumed that preprocessing is to preprocess some dataframe to prepare for certain analysis. Data transformation is more general and can be placed before or after the analysis. Happy to hear your thought too. @cisaacstern

cisaacstern commented 1 week ago

I assumed that preprocessing is to preprocess some dataframe to prepare for certain analysis. Data transformation is more general and can be placed before or after the analysis.

That makes sense! I think the word "transformation" in my mind is just quite generic and a bit overloaded (then again, so is "preprocessing" 🙃 )... so this clarification is helpful. I'm happy moving forward with this naming for now! I don't have a strong opinion about changing it, but perhaps its worth putting it to the group / UI folks to see if there are any other alternative names we should be considering.