microsoft / Trill

Trill is a single-node query processor for temporal or streaming data.
MIT License
1.25k stars 132 forks source link

External state management using FASTER #11

Open cybertyche opened 5 years ago

cybertyche commented 5 years ago

The present (default) implementation of Trill has all memory management done by .Net and in-memory. We are in the process of making implementations of Trill operators that use the FASTER key-value store engine for state management instead. Doing so will allow the option of having operator state spanning both memory and disk, and would allow for potentially faster checkpointing and recovery.

Should the FASTER version of operators prove to have similar or better performance than their previous versions, we will remove the previous versions in favor of the new ones to reduce code duplication.

Repo link for FASTER: https://github.com/microsoft/faster

jurby commented 5 years ago

@cybertyche @peterfreiling Any updates about TRILL+FASTER, please?

jurby commented 4 years ago

Hi, @cybertyche @peterfreiling I would like to ask if you are working on a Faster Trill implementation? Thank you.

peterfreiling commented 4 years ago

@jurby we currently do not have work planned for this integration.