Fix the load routine

[lizconlan]

Current load routine = rubbish, slow and times out on Heroku :(

All suggestions gratefully received!

[lizconlan]

Rails background tasks? May not work under Heroku tho

• http://stackoverflow.com/questions/897605/ruby-on-rails-how-to-run-things-in-the-background
• http://github.com/ncr/background-fu
• http://www.scribd.com/doc/2589535/Handling-LongRunning-Tasks-in-Rails
• http://napkin.highgroove.com/articles/2008/05/21/running-background-jobs-in-ruby-on-rails-revisited
• http://www.tobinharris.com/past/2009/3/9/6-ways-to-run-background-jobs-in-rubyonrails/

[lizconlan]

Load routine currently based on Background Fu

Now trying to get the jobs to run on Heroku

Heroku seems to prefer DJ which is a chargeable add-on :( http://blog.heroku.com/archives/2009/7/15/background_jobs_with_dj_on_heroku/

[lizconlan]

Recursive AJAX calls? Throw it into a loop of smaller calls (1 call per 20 results)?

[lizconlan]

Background Fu. Works well