gexijin / idepGolem

17 stars 11 forks source link

Some analysis taking hours to run #129

Open gexijin opened 2 years ago

gexijin commented 2 years ago

What Looking at the Docker container CPU usage, I can see that some containers are busy at 100% for hours, probably stuck at some steps. It is possible that users upload huge files. More likely it is some performance issues in the code. Solution Test code with different datasets. Using the Profile menu in R to monitor efficiency. Follow the steps in this chapter to improve efficiency overall. http://adv-r.had.co.nz/Performance.html

EricTulowetzke commented 2 years ago

This happens in the Pathway tab

add a submit button cause it is easy to overflow the stack with a lot of Calculation that the user doesn't want or need, due to each setting that change then adds a new process to be done.

@gexijin let's make this high need to fix

The newer Adv. R book: https://adv-r.hadley.nz/perf-improve.html

The Golem book to speed up code: https://engineering-shiny.org/need-for-optimization.html