search

bsed / ala

Automatically exported from code.google.com/p/ala
0 stars 0 forks source link

Pipeline for background compute-intensive tasks #82

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
Original Issue  - 
https://code.google.com/p/alageospatialportal/issues/detail?id=1075

Project Member Reported by leebel...@gmail.com, Jul 11, 2013 
While users can send compute intensive tasks to background processing, there is 
no management of the number and intensity of tasks. It is highly likely (and 
desirable) that the number of 'hard' tasks increase over time. These can be ALA 
tasks (e.g., processing layers) or user-tasks. 

It would therefore be wise to setup a way to shuffle such tasks off to a 
pipeline that could schedule and manage compute-intensive tasks and notify 
authors when complete. In this way, we could better manage impact on servers. 
Obviously a separate server for the pipeline would be neat.

Original issue reported on code.google.com by moyesyside on 8 Aug 2013 at 12:42

GoogleCodeExporter commented 9 years ago 
[deleted comment]
GoogleCodeExporter commented 9 years ago 
More of an enhancement than a bug, and still a significant issue that relates 
to a need to tap 'supercomputer resources' such as NCI.

Original comment by leebel...@gmail.com on 28 Apr 2014 at 12:53