search

akvo / akvo-flow

A data collection and monitoring tool that works anywhere.
http://akvo.org/products/akvoflow/
GNU Affero General Public License v3.0
65 stars 31 forks source link

TestHarness `deleteSurveyResponses` action causing erroneous counts #696

Closed muloem closed 4 years ago

muloem commented 10 years ago

The deleteSurveyResponses action has been used mostly for clearing out responses on trial instances that typically have a few survey responses. However, when used to delete surveys containing a larger number of survey instances, the counts for data summarisation are off when the same data is reloaded through a RAW DATA format. To be investigated to pinpoint what is the cause.

muloem commented 10 years ago

In addition, for surveys with lots of responses, the following exception is always thrown:

com.google.apphosting.api.ApiProxy$CancelledException: The API call datastore_v3.Put() was explicitly cancelled.
    at com.google.apphosting.runtime.ApiProxyImpl$5.get(ApiProxyImpl.java:387)
    at com.google.apphosting.runtime.ApiProxyImpl$5.get(ApiProxyImpl.java:384)
    at com.google.appengine.api.utils.FutureWrapper.get(FutureWrapper.java:88)
    at com.google.appengine.api.datastore.Batcher$ReorderingMultiFuture.get(Batcher.java:131)
    at com.google.appengine.api.utils.FutureWrapper.get(FutureWrapper.java:88)
    at com.google.appengine.api.utils.FutureWrapper.get(FutureWrapper.java:88)
    at com.google.appengine.api.utils.FutureWrapper.get(FutureWrapper.java:88)
    at com.google.appengine.api.datastore.FutureHelper.getInternal(FutureHelper.java:71)
    at com.google.appengine.api.datastore.FutureHelper.quietGet(FutureHelper.java:32)
    at com.google.appengine.api.datastore.DatastoreServiceImpl.put(DatastoreServiceImpl.java:56)
muloem commented 10 years ago

The issue with counts is connected to #651 which is attributed to having a synchronised class function that causes a large delay during processing. https://github.com/akvo/akvo-flow/blob/release/1.7.1/GAE/src/org/waterforpeople/mapping/analytics/dao/SurveyQuestionSummaryDao.java#L48

stale[bot] commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.