umn-asr / peoplesoft_course_class_data

0 stars 0 forks source link

Too many terms causing memory allocation errors #51

Closed truetone closed 4 years ago

truetone commented 4 years ago

The nightly import process is giving us this error:

rake aborted!
Errno::ENOMEM: Cannot allocate memory - fork(2)
/swadm/www/courses.umn.edu/releases/20191113213628/lib/tasks/json_import.rake:56:in `fork'
/swadm/www/courses.umn.edu/releases/20191113213628/lib/tasks/json_import.rake:56:in `block (4 levels) in <top (required)>'
/swadm/www/courses.umn.edu/releases/20191113213628/lib/tasks/json_import.rake:55:in `each'
/swadm/www/courses.umn.edu/releases/20191113213628/lib/tasks/json_import.rake:55:in `block (3 levels) in <top (required)>'
/swadm/www/courses.umn.edu/releases/20191113213628/lib/tasks/json_import.rake:54:in `each'
/swadm/www/courses.umn.edu/releases/20191113213628/lib/tasks/json_import.rake:54:in `each_slice'
/swadm/www/courses.umn.edu/releases/20191113213628/lib/tasks/json_import.rake:54:in `block (2 levels) in <top (required)>'
/swadm/www/courses.umn.edu/shared/bundle/ruby/2.3.0/gems/rake-13.0.1/exe/rake:27:in `<top (required)>'
Tasks: TOP => json_import:update_all => json_import:directory_import
(See full trace by running task with --trace)

Reduce the number of terms we retrieve.