devitocodes / devito

DSL and compiler framework for automated finite-differences and stencil computation
http://www.devitoproject.org
MIT License
555 stars 225 forks source link

Container for managing wave-field time history #29

Closed ggorman closed 8 years ago

ggorman commented 8 years ago

Need to add a container for storing the time history of the forward model.

Strict requirements:

  1. API should be abstracted for opesci/devito so that the container backend can be replaced in the future if necessary.
  2. Support for very large datasets - out of core support.
  3. Configurable to use available RAM - spilling to disk when necessary.
  4. Need to be able to specify storage device.

Desirable features:

  1. Data structure should behave as a stack - i.e. last in first out (LIFI) data structure.
  2. Support for non-blocking push and pop.
  3. Prefetching from disk while popping.

Initial suggestion is to build support around stxxl::stack - http://stxxl.sourceforge.net/tags/master/tutorial_stack.html

mlange05 commented 8 years ago

Did the recent memmap PR address this problem in full? Can this now be closed?

ggorman commented 8 years ago

I believe so. We can close this issue for now as it's use if explored in the inversion repo.

On Mon, 18 Jul 2016 at 15:04 Michael Lange notifications@github.com wrote:

Did the recent memmap PR address this problem in full? Can this now be closed?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/opesci/devito/issues/29#issuecomment-233337939, or mute the thread https://github.com/notifications/unsubscribe-auth/AFJRA3YSl8FE5zkEdG8jVFsdf0YAH0fyks5qW4gIgaJpZM4I5l7A .