search

zingzeu / CrowdSource

Crowdsourcing coordination and state management tool
http://cs.mindong.asia
MIT License
2 stars 0 forks source link

Sharding / federation #9

Open ztl8702 opened 6 years ago

ztl8702 commented 6 years ago

A task pool can be divided into multiple shards.

Server exchange shards. One task can only be on one server at any time. Need a resilient way to exchange stuff.

DB only stores metadata, not resource blobs. Resources are not sharded.

ztl8702 commented 6 years ago

Or "hand off" some portion of the task pool to AWS Mturk and other external services