microsoftarchive / data-pipeline

Exploring the problem of high-scale data ingestion on Azure
MIT License
6 stars 4 forks source link

simulator does not work as expected #17

Open bennage opened 9 years ago

bennage commented 9 years ago

The simulator does not send the number of events that it is expected to (i.e., what is set in the configuration). It seems to produce ~70% of the expected number. This observation is based on performance counters. The overall design of the simulator may be flawed. There is some concern that it abuses the TPL.

We need to

  1. Understand the current behavior more fully.
  2. Determine what design changes need to take place in order for the simulator to behave as expected.