search

rogerlew / wepppy

Other
10 stars 7 forks source link

Redis Queue for running wepp #293

Open rogerlew opened 1 month ago

rogerlew commented 1 month ago

https://chatgpt.com/c/07ed04b6-837f-4a50-83d5-bb147c616d61

rogerlew commented 1 month ago 
sudo -u www-data rq worker-pool -n 20 -u redis://129.101.202.237:6379/9 run_ss_batch_hillslope run_hillslope run_flowpath run_watershed run_ss_batch_watershed
sudo -u www-data rq worker-pool -n 20 -u redis://129.101.202.237:6379/9 --worker-class 'wepppy.rq.WepppyRqWorker' high default low
rogerlew commented 1 month ago

View current worker status

rq info --url redis://129.101.202.237:6379/9
rogerlew commented 1 month ago

import os import redis from rq import Queue from rq.job import Job from wepppy.nodb.wepp import run_wepp_rq REDIS_HOST = os.environ.get('REDIS_HOST', 'localhost') RQ_DB = 9 redis_conn = redis.Redis(host=REDIS_HOST, port=6379, db=RQ_DB) q = Queue(connection=redis_conn) job = q.enqueue(run_wepp_rq, '/geodata/weppcloud_runs/orphaned-dioxide/')

rogerlew commented 1 month ago 
redis-cli -h 129.101.202.237 -p 6379 -n 2 MONITOR