search

emews / EQ-SQL

1 stars 0 forks source link

EQ-SQL Tables (Milestone 1 Version) #6

Closed jozik closed 1 year ago

jozik commented 3 years ago

EQ-SQL tables and sequence diagram here: https://docs.google.com/document/d/1akhR2yVe5TZcMyQSBpAs0KLQ6zxBz5pH9jHTraoQ9ZY/edit#bookmark=id.d695ufn8hs91

Notes:

Task Querier (TQ) is responsible for grabbing tasks, payloads, etc. from DB based on priority/type, and populating any relevant tables (e.g., Task Progress Table) Task Reporter (TR) pushed task ID, results back, including metadata (error flags, etc.)

jozik commented 3 years ago

A great test case for the task type differentiation by e.g., PPN configuration would have one e.g., PPN=64 worker pool (type 1) and another PPN=1 worker pool (type 2), where type 1 runs sims and type 2 runs ML tasks. Could extend the example that Nick is putting together (hvr_sharpe). @ncollier