search

PILLUTLAAVINASH / google-enterprise-connector-manager

Automatically exported from code.google.com/p/google-enterprise-connector-manager
0 stars 0 forks source link

Increase default batch hint size and make configurable #180

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
Current batch hint seems to be set too low and is causing overhead given a
large amount of content to be traversed.  Current size is set in code to be
100.  Should change this to default to 500 and make the value configurable
from the applicationContext.xml file.

Original issue reported on code.google.com by mgron...@gmail.com on 2 Sep 2009 at 6:33

GoogleCodeExporter commented 8 years ago 
Fixed in branch at r2217 and up integrated to trunk at r2218.

Log message

Within HostLoadManger, changed BATCH_SIZE from class constant set at 100 to
instance variable defaulted to 500.  Also, made it settable from Spring.  Added
a related test.

Tried to place changes in areas close to related changes in truck to minimize
merge problems.

TESTS PASSED: All unit tests.

CHANGE LOG:

  M
source/java/com/google/enterprise/connector/scheduler/TraversalScheduler.java:
    - Changed constructor to take HostLoadManager rather than construct one.

  M source/java/com/google/enterprise/connector/scheduler/HostLoadManager.java:
    - Removed class constant for batch size and replaced with settable field.

  M source/javatests/com/google/enterprise/connector/scheduler/TraversalSchedule
rTest.java:
    - Fixed for new constructor.

  M source/javatests/com/google/enterprise/connector/scheduler/HostLoadManagerTe
st.java:
    - Added test to check HostLoadManager coming from Spring.

  A testdata/schedulerTests/applicationContext.xml:
    - New test file used to confirm HostLoadManager bean created

  M testdata/mocktestdata/applicationContext.xml:
  M etc/applicationContext.xml:
    - Added bean for HostLoadManager to support making the batchSize
      configurable outside the code.

Original comment by mgron...@gmail.com on 2 Sep 2009 at 6:39

GoogleCodeExporter commented 8 years ago

Original comment by jla...@google.com on 9 Dec 2010 at 10:43