keedio / flume-ftp-source

FTP network server is source of events for Apache-flume
80 stars 61 forks source link

if > 10000 files on discover -> java.lang.OutOfMemoryError: GC overhead limit exceeded #5

Closed lazaromedina closed 9 years ago

lazaromedina commented 9 years ago

Actually memory is -Xms20m for HashMap.

lazaromedina commented 9 years ago

solved with MEM >= 128 on -XmsMEMm

lazaromedina commented 9 years ago

Tested successfully with > 50000 files with a total size of 9.4 GB. -Xmx1024M on memory not on heap

image