search

educational-technology-collective / slicing-analysis

Slicing analysis and replication of (Xing et al 2016, Gardner and Brooks 2018, Fei and Yeung 2015) using the MOOC Replication Framework (MORF)
MIT License
4 stars 2 forks source link

gardner replication - feature extraction issue w/fantasysf #12

Closed jpgard closed 6 years ago

jpgard commented 6 years ago

specifically session 3, currently something is happening where cleanup is not executed in the output directory, resulting in multiple feature files

jpgard commented 6 years ago

also applies to the following:

[WARNING] multiple feature files detected in results, defaulting to use ['/home/jpgard/morf-install/job_runner/work/t mp428wlutu/tmp56wjh8xi/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp56 wjh8xi/design_002_quiz.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp56wjh8xi/user_dropout_weeks.cs v', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp56wjh8xi/week_2_clickstream_appended_feats.csv', '/home /jpgard/morf-install/job_runner/work/tmp428wlutu/tmp56wjh8xi/design_002_quiz_metadata.csv', '/home/jpgard/morf-instal l/job_runner/work/tmp428wlutu/tmp56wjh8xi/design_002_forum_text.csv']

[WARNING] multiple feature files detected in results, defaulting to use ['/home/jpgard/morf-install/job_runner/work/t mp428wlutu/tmp1erfe6ht/design_004_quiz_metadata.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp1erfe 6ht/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp1erfe6ht/design_004_f orum_text.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp1erfe6ht/user_dropout_weeks.csv', '/home/jp gard/morf-install/job_runner/work/tmp428wlutu/tmp1erfe6ht/week_2_clickstream_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp1erfe6ht/design_004_quiz.csv']
[WARNING] multiple feature files detected in results, defaulting to use ['/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpqbw8fjew/oldglobe_001_forum_text.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpqbw8fjew/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpqbw8fjew/oldglobe_001_quiz_metadata.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpqbw8fjew/user_dropout_weeks.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpqbw8fjew/week_2_clickstream_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpqbw8fjew/oldglobe_001_quiz.csv'] [WARNING] multiple feature files detected in results, defaulting to use ['/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmppime49ah/socialimpact_001_forum_text.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmppime49ah/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmppime49ah/user_dropout_weeks.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmppime49ah/socialimpact_001_quiz.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmppime49ah/week_2_clickstream_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmppime49ah/socialimpact_001_quiz_metadata.csv'] [WARNING] multiple feature files detected in results, defaulting to use ['/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/user_dropout_weeks.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/fantasysf_003_quiz_metadata.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/week_2_clickstream_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/fantasysf_003_quiz.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/fantasysf_003_forum_text.csv']

Last login: Wed Sep 26 13:50:05 on ttys002 2379589935:~ joshgardner$ ssh jpgard@nibbler.si.umich.edu jpgard@nibbler.si.umich.edu's password: Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.15.0-29-generic x86_64)

163 packages can be updated. 0 updates are security updates.

New release '18.04.1 LTS' available. Run 'do-release-upgrade' to upgrade to it.

System restart required Last login: Thu Sep 27 01:33:04 2018 from 141.213.169.47 $ pwd /home/jpgard $ cd slicing-analysis/gardner $ ls analysis-utils controller.py extraction gardner.tar README.md utils client.config dockerfile gardner.py modeling temp $ nano client.config $ nano controller.py $ screen -S gardner-nb

mp428wlutu/tmpb4fg5gsq/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/user_dropout_weeks.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/fantasysf_003_quiz_metadata.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/week_2_clickstream_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/fantasysf_003_quiz.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpb4fg5gsq/fantasysf_003_forum_text.csv'] [WARNING] multiple feature files detected in results, defaulting to use ['/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpvvx4o8yh/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpvvx4o8yh/fantasysf_006_quiz.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpvvx4o8yh/user_dropout_weeks.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpvvx4o8yh/week_2_clickstream_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpvvx4o8yh/fantasysf_006_quiz_metadata.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmpvvx4o8yh/fantasysf_006_forum_text.csv'] [WARNING] multiple feature files detected in results, defaulting to use ['/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp5m_aqo26/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp5m_aqo26/fantasysf_007_forum_text.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp5m_aqo26/fantasysf_007_quiz.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp5m_aqo26/user_dropout_weeks.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp5m_aqo26/week_2_clickstream_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp5m_aqo26/fantasysf_007_quiz_metadata.csv'] [WARNING] multiple feature files detected in results, defaulting to use ['/home/jpgard/morf-install/jobrunner/work/tmp428wlutu/tmpbhow76t/fantasysf_008_quiz_metadata.csv', '/home/jpgard/morf-install/jobrunner/work/tmp428wlutu/tmpbhow76t/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/jobrunner/work/tmp428wlutu/tmpbhow76t/fantasysf_008_forum_text.csv', '/home/jpgard/morf-install/jobrunner/work/tmp428wlutu/tmpbhow76t/fantasysf_008_quiz.csv', '/home/jpgard/morf-install/jobrunner/work/tmp428wlutu/tmpbhow76t/user_dropout_weeks.csv', '/home/jpgard/morf-install/jobrunner/work/tmp428wlutu/tmpbhow76t/week_2_clickstream_appended_feats.csv'] [WARNING] multiple feature files detected in results, defaulting to use ['/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp9gqck0bw/fantasysf_009_forum_text.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp9gqck0bw/fantasysf_009_quiz.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp9gqck0bw/week_2_forum_appended_feats.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp9gqck0bw/fantasysf_009_quiz_metadata.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp9gqck0bw/user_dropout_weeks.csv', '/home/jpgard/morf-install/job_runner/work/tmp428wlutu/tmp9gqck0bw/week_2_clickstream_appended_feats.csv']

jpgard commented 6 years ago

this means fantasysf (003, 006, 007, 008, 009), design 002, design 004, oldglobe 001, socialimpact 001.

jpgard commented 6 years ago

fixed w/most recent commit; change to logic in quiz feature extractor was dropping all quiz data in courses where quizzes weren't used, which led to downstream failure of aggregatino of different feature types in gardner.py