search

zkfan / tungsten-replicator

Automatically exported from code.google.com/p/tungsten-replicator
0 stars 0 forks source link

tungsten replicator goes out of memory #139

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?

1. Install replicator with 20 channels
2. Start working on the master with 20 databases
3.

What is the expected output?

normal replication in parallel

What do you see instead?

INFO   | jvm 1    | 2011/06/29 15:57:47 | 2011-06-29 15:57:47,665 INFO  
thl.log.LogIndex Adding new index entry for thl.data.0000000006 starting at 
seqno 940
INFO   | jvm 1    | 2011/06/29 15:57:52 | 2011-06-29 15:57:51,959 ERROR 
replicator.thl.THLParallelReadTask Read failed on transaction log: seqno=947 
taskId=18
INFO   | jvm 1    | 2011/06/29 15:57:52 | java.lang.OutOfMemoryError: Java heap 
space
INFO   | jvm 1    | 2011/06/29 15:57:52 |   at 
com.continuent.tungsten.replicator.thl.log.LogFile.readRecord(LogFile.java:571)
INFO   | jvm 1    | 2011/06/29 15:57:52 |   at 
com.continuent.tungsten.replicator.thl.log.LogConnection.next(LogConnection.java
:418)
INFO   | jvm 1    | 2011/06/29 15:57:52 |   at 
com.continuent.tungsten.replicator.thl.log.LogConnection.next(LogConnection.java
:490)
INFO   | jvm 1    | 2011/06/29 15:57:52 |   at 
com.continuent.tungsten.replicator.thl.THLParallelReadTask.run(THLParallelReadTa
sk.java:232)
INFO   | jvm 1    | 2011/06/29 15:57:52 |   at java.lang.Thread.run(Unknown 
Source)
INFO   | jvm 1    | 2011/06/29 15:57:52 | 2011-06-29 15:57:52,737 ERROR 
replicator.thl.THLParallelReadTask Read failed on transaction log: seqno=947 
taskId=13
INFO   | jvm 1    | 2011/06/29 15:57:52 | java.lang.OutOfMemoryError: Java heap 
space
INFO   | jvm 1    | 2011/06/29 15:57:52 | 2011-06-29 15:57:52,737 INFO  
replicator.thl.THLParallelReadTask Terminating parallel reader thread: 
seqno=947 store=thl taskId=13
INFO   | jvm 1    | 2011/06/29 15:57:53 | 2011-06-29 15:57:52,632 ERROR 
replicator.thl.THLParallelReadTask Read failed on transaction log: seqno=947 
taskId=11
INFO   | jvm 1    | 2011/06/29 15:57:53 | java.lang.OutOfMemoryError: Java heap 
space
INFO   | jvm 1    | 2011/06/29 15:57:53 | 2011-06-29 15:57:52,178 ERROR 
replicator.thl.THLParallelReadTask Read failed on transaction log: seqno=946 
taskId=12
INFO   | jvm 1    | 2011/06/29 15:57:53 | java.lang.OutOfMemoryError: Java heap 
space
INFO   | jvm 1    | 2011/06/29 15:57:53 |   at 
com.continuent.tungsten.replicator.thl.log.LogFile.readRecord(LogFile.java:571)
INFO   | jvm 1    | 2011/06/29 15:57:53 |   at 
com.continuent.tungsten.replicator.thl.log.LogConnection.next(LogConnection.java
:418)
INFO   | jvm 1    | 2011/06/29 15:57:53 |   at 
com.continuent.tungsten.replicator.thl.log.LogConnection.next(LogConnection.java
:490)
INFO   | jvm 1    | 2011/06/29 15:57:53 |   at 
com.continuent.tungsten.replicator.thl.THLParallelReadTask.run(THLParallelReadTa
sk.java:232)
INFO   | jvm 1    | 2011/06/29 15:57:53 |   at java.lang.Thread.run(Unknown 
Source)
INFO   | jvm 1    | 2011/06/29 15:57:53 | 2011-06-29 15:57:53,245 INFO  
replicator.thl.THLParallelReadTask Terminating parallel reader thread: 
seqno=946 store=thl taskId=12
INFO   | jvm 1    | 2011/06/29 15:57:53 | 2011-06-29 15:57:52,178 ERROR 
replicator.thl.THLParallelReadTask Read failed on transaction log: seqno=946 
taskId=17
INFO   | jvm 1    | 2011/06/29 15:57:53 | java.lang.OutOfMemoryError: Java heap 
space

What is the possible cause?

More memory than planned is allocated 

What is the proposed solution?

N/A

Original issue reported on code.google.com by g.maxia on 29 Jun 2011 at 2:15

GoogleCodeExporter commented 9 years ago

Original comment by g.maxia on 29 Jul 2011 at 3:12