search

sashafrey / topicmod

This project had been moved to https://github.com/bigartm/bigartm
Other
0 stars 0 forks source link

Improve DataLoader.WaitIdle() method #24

Closed sashafrey closed 10 years ago

sashafrey commented 10 years ago

Branch https://github.com/sashafrey/topicmod/tree/alfrey_data_loader_streams introduces two new operations: DataLoader.WaitIdle() and Instance.WaitIdle(). A better solution would be to

  1. Processor notifies DataLoader when it is done with batch (via some sort of callback)
  2. DataLoader.WaitIdle() waits for all callbacks from Processors
  3. Instance.WaitIdle() is removed.
sashafrey commented 10 years ago

Fixed with new Callback() mechanism in DataLoader.