Briefcase not retrieving all submissions

GoogleCodeExporter commented 9 years ago

Email to list 
http://groups.google.com/group/opendatakit/browse_thread/thread/b03e753799eee225

Hello.

I'm using ODK Briefcase v1.0.2.1 (ODK_Briefcase_1.0.2.1.jar) to pull and export 
submissions for a form that uses repeated groups (Briefcase's ability to 
preserve relationships is important here). In ODK Aggregate, from the bulk CSV 
export I can see that I have, at one time, 207 form submissions. However, when 
I use ODK Briefcase to Pull these instances, I only get 100, hence the log (in 
"Details..." under the "Pull" tab):

Fetching form definition
Fetching form manifest
 (getting 1 of 1 media files)
preparing to retrieve instance data
retrieving next chunk of instances from server...
fetching instance 1 ...
fetching instance 2 ...
fetching instance 3 ...

[MY EDIT: continues fetching instances 4 through 96]

fetching instance 97 ...
fetching instance 98 ...
fetching instance 99 ...
fetching instance 100 ...
retrieving next chunk of instances from server...
retrieving next chunk of instances from server...
SUCCESS!

Indeed, in the "ODK Briefcase Storage" there are only 100 instances; same as in 
the export from ODK Briefcase. How do I get the remaining instances?

Thanks!

Original issue reported on code.google.com by wbrune...@gmail.com on 23 Jun 2012 at 5:52

GoogleCodeExporter commented 9 years ago

If you can add me ( mitchellsundt@gmail.com ) as a Site Admin to your site and 
also invite me to be a developer ( 
http://code.google.com/p/opendatakit/wiki/AppEngineTroubleshooting ) I can try 
running Briefcase myself and see where this is failing.

Original comment by mitchellsundt@gmail.com on 25 Jun 2012 at 6:28

GoogleCodeExporter commented 9 years ago

I've added you as a Site Admin; I sent you an e-mail with the details. Note 
that this instance is not on Google AppEngine so I didn't invite you to be a 
developer through that channel.

Original comment by kaend...@mtu.edu on 25 Jun 2012 at 8:09

GoogleCodeExporter commented 9 years ago

I've confirmed that this is a bug.  The timestamp in the continuation cursor 
has a timezone error.

e.g.,

http://odkaggregate.mtri.org:8080/ODKAggregate/view/submissionList?formId=MDOT_S
eatbelt_Survey_Final&numEntries=10

yields this resumption cursor:

<cursor 
xmlns="http://www.opendatakit.org/cursor"><attributeName>_LAST_UPDATE_DATE</attr
ibuteName><attributeValue>2012-06-04T01:28:01.626+0000</attributeValue><uriLastR
eturnedValue>uuid:a9da3981-895f-4640-bba0-5ab32faa9d20</uriLastReturnedValue><is
ForwardCursor>true</isForwardCursor></cursor>

but the correct resumption cursor should be 4 hours earlier:

<cursor 
xmlns="http://www.opendatakit.org/cursor"><attributeName>_LAST_UPDATE_DATE</attr
ibuteName><attributeValue>2012-06-03T21:28:01.626+0000</attributeValue><uriLastR
eturnedValue>uuid:a9da3981-895f-4640-bba0-5ab32faa9d20</uriLastReturnedValue><is
ForwardCursor>true</isForwardCursor></cursor>

Original comment by mitchellsundt@gmail.com on 26 Jun 2012 at 10:47

GoogleCodeExporter commented 9 years ago

The server is running ODK Aggregate 1.0.1

Please upgrade to ODK Aggregate 1.0.9

The problem should have been fixed with this code change (Nov 10, 2011):

http://code.google.com/p/opendatakit/source/detail?r=3f7febf9fd106dc182dd3aa4dc1
d02e20713fdf2&repo=aggregate&path=/src/main/java/org/opendatakit/common/utils/We
bUtils.java

Original comment by mitchellsundt@gmail.com on 27 Jun 2012 at 9:12

javirosa / opendatakit

Briefcase not retrieving all submissions #614