RPC threads are contending for HTable access

[shvachko]

Original issue 89 created by shvachko on 2014-10-03T23:36:44.000Z:

In NamespaceProcessor there is a single HBase client, an HTable, that is shared between a client connections.

It is possible to have multiple HBase clients, so we can parallelize client operations better.

[shvachko]

Comment #1 originally posted by shvachko on 2014-10-17T17:01:15.000Z:

Milan, did you do your YARN test with this patch? Or was it excluded?

[shvachko]

Comment #2 originally posted by shvachko on 2014-10-17T17:48:32.000Z:

I didn't it test it with this patch, but I will do that right now.

[shvachko]

Comment #3 originally posted by shvachko on 2014-10-17T18:12:50.000Z:

YARN with teragen, terasort, and teravalidate run successfully. +1

[shvachko]

Comment #4 originally posted by shvachko on 2014-10-17T19:05:53.000Z:

Alright lets commit this then as well. You can log it as an improvement.

[shvachko]

Comment #5 originally posted by shvachko on 2014-10-17T19:18:42.000Z:

testFiveListingWithSameRoot is failing for me on Maven. I'll look into it after lunch, but if you get a chance can you check if it's failing for you too?

[shvachko]

Comment #6 originally posted by shvachko on 2014-10-18T00:08:55.000Z:

The test was failing because after creating 128 directories in /, there will be 129 directories noticed by getListing(). The tests expects 128. This is because of the /user directory that is automatically created during format. Changing the default topdir used to "." from "/" fixes the issue. I posted a revised patch. If you +1 the change I'll commit.

[shvachko]

Comment #7 originally posted by shvachko on 2014-10-18T01:12:02.000Z:

This is correct. Good catch Milan. +1 for sure.

[shvachko]

Comment #8 originally posted by shvachko on 2014-10-18T01:17:39.000Z:

Committed.