Project Checkpoint Feedback

Score (out of 7 pts)

Score = 7

Feedback

Category	Full Point	Your Score
Abstract	0.5	-0
Background	0.5	-0
Problem Statement	0.5	-0
Data	1	-0
Proposed Solution	1	-0
Metrics	1	-0
Preliminary Results	1	-0
Ethics & Privacy	1	-0
Team expectations	0.25	-0
Timeline	0.25	-0

Rubric

Category	Full Point	Explanation
Abstract	0.5	Abstract is informative, succinct, and clear. It offers specific details about the educational issue, variables (data), context, proposed methods, and measurement of performance/success of the study.
Background	0.5	Use a minimum of 2 or 3 citations Include a general introduction to your topic Narrative integrates critical and logical details from the peer-reviewed theoretical and research literature. Each key research component is grounded to the literature. Attention is given to different perspectives, threats to validity, and opinion vs. evidence.
Problem Statement	0.5	Presents a well-defined and significant research problem Include at least one ML-relevant potential solution. Articulates clear, reasonable research questions given the purpose, design, and methods of the project. All variables and controls have been appropriately defined. Proposals are clearly supported from the research and theoretical literature. All elements are mutually supportive.
Data	1	Multiple data sources for each aspect of the project. All data sources are fully described and referenced. Data is appropriate to the question/goal and large enough data points >1k observations and >5 variable The details of the descriptions also make it clear how they support the needs of the project.
Proposed Solution	1	The elements of the process were described succinctly and with clarity about how they are connected to each other Included description how the solution will be tested.
Metrics	1	The metrics are described clearly and succinctly. Their appropriateness for addressing the research problem is clearly described. Provided the mathematical representations of metrics
Preliminary Results	1	Analyzing the suitability of a dataset or algorithm for prediction/solving your problem Performing feature selection or hand-designing features from the raw data. Describe the features available/created and/or show the code for selection/creation Dataset actually clean and usable after feature selection is carried out Showing the performance of a base model/hyper-parameter setting. Solve the task with one "default" algorithm and characterize the performance level of that base model. At least one of the three: Learning curves or validation curves for a particular model Tables/graphs showing the performance of different models/hyper-parameters
Ethics & Privacy	1	Thoughtful discussion of ethical concerns included. Ethical concerns consider the whole data science process (question asked, data collected, data being used, the bias in data, analysis, post-analysis, etc.). How your group handled bias/ethical concerns clearly described
Team expectations	0.25	The list clearly was the subject of a thoughtful approach and already indicates a well-working team
Timeline	0.25	The timeline was clearly the subject of a thoughtful approach and indicates that the team has a detailed plan that seems appropriate and completable in the allotted time.

Comments

Everything looks great to me; for the heatmap, maybe consider using a 2-tone color camp so that you can see the correlation between different features. Right now, it works, but it is not that great for the visualization aspect because I cannot tell if yellow is stronger than green. For the loss function, right now, it still looks huge, but I did not see any coding problem since you are using the nn package, if others like the accuracy or other metric of evaluation looks great, the I guess the loss is designed to be this big.

COGS118A / Group020-SP23