search

hastapasta / financereport

Automatically exported from code.google.com/p/financereport
0 stars 0 forks source link

Test database garbage collection process #24

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago 
Test database garbage collection process

Original issue reported on code.google.com by hastapas...@gmail.com on 23 Nov 2010 at 5:44

GoogleCodeExporter commented 8 years ago 
Found a few bugs; made some fixes. Stepped through a complete test and looks 
better now.

Original comment by hastapas...@gmail.com on 28 Nov 2010 at 6:04

GoogleCodeExporter commented 8 years ago 
Garbage collector ran on 12/19 and threw an out of memory exception.

Original comment by hastapas...@gmail.com on 20 Dec 2010 at 3:57

GoogleCodeExporter commented 8 years ago 
Right now I'm focusing on garbage collection the xrateorg datasets and in order 
to adequately test I need to have the charting figured out:

http://code.google.com/p/financereport/issues/detail?id=12&sort=-status

Original comment by hastapas...@gmail.com on 21 Dec 2010 at 7:45

GoogleCodeExporter commented 8 years ago 
Getting the following exception during the garbage collection process:

Exception in thread "Thread-0" java.lang.OutOfMemoryError: GC overhead limit 
exceeded
    at CustomBufferedWriter.writeln(CustomBufferedWriter.java:125)
    at DBFunctions.db_run_query(DBFunctions.java:139)
    at GarbCollector.takeOutTrash(GarbCollector.java:119)
    at DataLoad.garbageCollectionFunction(DataLoad.java:505)
    at DataLoad.run(DataLoad.java:810)

Going to try to increase the heap size. Increased the virtual image memory from 
2 GB to 3 GB.

Original comment by hastapas...@gmail.com on 27 Dec 2010 at 6:15

GoogleCodeExporter commented 8 years ago 
Tried increasing heap size to 1GB. Garbage collector seemed to run longer but 
still ended up throwing the OutOfMemoryError.

Now going to try to reduced the size of the query by filter on 
garbage_collect=0.

Original comment by hastapas...@gmail.com on 27 Dec 2010 at 8:51

GoogleCodeExporter commented 8 years ago 
Had another memory issue over the weekend - got a head dump and need to analyze 
it.

Something else that was disconcerting was that the outofmemory exception wasn't 
written anywhere in the logs.

Original comment by hastapas...@gmail.com on 24 Jan 2011 at 3:02

GoogleCodeExporter commented 8 years ago

Original comment by hastapas...@gmail.com on 15 Feb 2011 at 2:40

GoogleCodeExporter commented 8 years ago 
For now create a property in dataload.ini to disable the garbage collector 
completely and then enable that property.

Original comment by hastapas...@gmail.com on 22 Feb 2011 at 4:53

GoogleCodeExporter commented 8 years ago

Original comment by hastapas...@gmail.com on 22 Feb 2011 at 5:05

GoogleCodeExporter commented 8 years ago 
Added "disable gc" code and the dataload.ini property.

Original comment by hastapas...@gmail.com on 22 Feb 2011 at 5:18