Performance

[andyl]

Currently the systems processes a few writes per second. It need to handle at least tens of thousands of writes per second.

Performance improvement ideas:

• performance benchmarking of read and write operations
• benchmark thru CLI and also server-side
• replace rails with elixir/phoenix and commanded
• add a turbo-mode which disables event-stream writing (for research)
• load pre-generated event streams (for research)
• use async writes
• LRU cache for data fetching
• decompose contract/cross & search for optimizations
• split users/issues/offers/contracts into parallel write streams w/vector clock
• figure out some sort of sharding strategy
• look for ways to parallelize write operations with GenServers

Here's a diagram of our architecture...