Open fr3dgu1s opened 6 years ago
Hi @fr3dgu1s, this issue is because the continuation token size sent in the header is too large. You can limit this by setting the 'responseContinuationTokenLimitInKb' in your feedOptions. (i.e. feedOptions.setResponseContinuationTokenLimitInKb() ). The maximum header size is 16 Kb, so your choice for responseContinuationTokenLimitInKb should be within that.
While running a query against my database and getting a 'Request size is too large' while iterating through the results:
The query is 'select c.id, c.snippet.channelId from c where (c.kind = 'youtube#channel' or c.kind = 'youtube#video') and c.statistics.commentCount > 0'
Stack Trace:
java.util.concurrent.ExecutionException: java.lang.IllegalStateException: com.microsoft.azure.documentdb.DocumentClientException: {'Errors':['Request size is too large']} ActivityId: 00000000-0000-0000-0000-000000000000, Request URI: //, StatusCode: RequestEntityTooLarge, SubStatusCode: at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.affinio.work.Worker$class.waitUntilDone(Worker.scala:51) at com.affinio.scanner.CommentScan$.waitUntilDone(CommentScan.scala:11) at com.affinio.work.Worker$class.cleanUp(Worker.scala:87) at com.affinio.scanner.CommentScan$.com$affinio$reader$Reader$$super$cleanUp(CommentScan.scala:11) at com.affinio.reader.Reader$class.cleanUp(Reader.scala:147) at com.affinio.scanner.CommentScan$.cleanUp(CommentScan.scala:11) at com.affinio.work.Worker$class.main(Worker.scala:105) at com.affinio.scanner.CommentScan$.main(CommentScan.scala:11) at com.affinio.scanner.CommentScan.main(CommentScan.scala) Caused by: java.lang.IllegalStateException: com.microsoft.azure.documentdb.DocumentClientException: {'Errors':['Request size is too large']}
Once the item is already on the database the error should not be related to document size.