basho / riak-java-client

The Riak client for Java.
Apache License 2.0
267 stars 158 forks source link

Getting error "Unknown message code: 11" during get object from Riak [JIRA: CLIENTS-1018] #681

Closed lukebakken closed 8 years ago

lukebakken commented 8 years ago

Original issue: basho/riak#879

com.basho.riak.client.core.netty.RiakResponseException: Unknown message code: 11
at com.basho.riak.client.core.netty.RiakResponseHandler.channelRead(RiakResponseHandler.java:52) ~[com.basho.riak.riak-client-2.0.5.jar:na]
at
lukebakken commented 8 years ago

@AliakseiMat - can you please provide the version of the following software you're using?

AliakseiMat commented 8 years ago

Riak-java-client: 2.0.5 Riak: 2.1.3 So, we got those errors during data migration process and huge numbers of read/write requests was triggered. Thanks!

lukebakken commented 8 years ago

Can you provide more information about this data migration process? Are you using a proxy server in your environment?

lukebakken commented 8 years ago

Were any Riak nodes shut down or did any crash during this process?

AliakseiMat commented 8 years ago

No, we have 9 nodes, each running on separate ec2 and the separate machine for the server itself (only one server node was involved in migration). No one node was crashed when those errors occurred.

AliakseiMat commented 8 years ago

After re-migrating for the tenants who had those errors, every things went fine.

lukebakken commented 8 years ago

The "Unknown message code" error can happen when a Riak node is starting up or shutting down and the API hasn't fully initialized. I doubt you will see this error again. If you do, please re-open this issue.

AliakseiMat commented 8 years ago

Ohh, I see. So, since Riak possibly auto-recovered that why we didn't see any nodes down.

alexmoore commented 8 years ago

Yep, and if the Java client saw an error response it should have retried the command up to 3 times total on different connections. Do you run with the built-in LB or do you use an external one like Nginx, F5, etc?

On Mon, Oct 24, 2016 at 8:11 PM, Alex notifications@github.com wrote:

Ohh, I see. So, since Riak possibly auto-recovered that why we didn't see any nodes down.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/basho/riak-java-client/issues/681#issuecomment-255901035, or mute the thread https://github.com/notifications/unsubscribe-auth/AAAFnuHWE4vS0VO5pr4o7cuC8EzRun8jks5q3Uk3gaJpZM4KfL_H .

AliakseiMat commented 8 years ago

Yes, we have LB in front of all our 9 nodes. Got it, thanks!

Basho-JIRA commented 7 years ago

Fixed, or closed via GitHub issues.

[posted via JIRA by Alexander Moore]