Session 4: check overview slide

csch0lz commented 4 months ago

Check slide "Overview tidying steps"

xgaouva commented 3 months ago

My comments in (Italic):

Overview Data Tidying Steps

Determine the initial structure of your dataset. (I am not sure what does this mean?)
What are they primary keys? (Maybe remove this as it makes more sense to check primary keys after checking P1, P2 P3?)
What violations of the tidy data principles can you see?
Address any issues:
- Start with Principle 1 (redistributing data to different tibbles if necessary) (first check duplicated rows even before P1)
- Continue with Principle 2 (pivot_longer)
- Finish by addressing issues for Principle 3 and 4
Confirm and document the new structure of your dataset.
- What are the primary and foreign keys of the final data set? (Should this even be the last step after join?)
- How can different data sources be joined?

This concludes data tidying.

csch0lz commented 2 months ago

Thanks @xgaouva ! I made some adjustments. Couple of responses to your comments:

They should check primary keys before doing anything to the dataset. That is part of determining what the structure of their dataset is. If they don't understand exactly what is in their data and how its structure, they can't tidy it effectively.
Checking for duplicate rows is part of checking for a primary key (i.e. there is not primary key if there are duplicates).
Joining is not part of data tidying. Data tidying ends with separate dibbles for different types of data. At the end of tidying, they should be able to describe how different data sources CAN be joined, but the actual joining would be part of a specific analysis, not the data tidying process.