search

jprante / elasticsearch-jdbc

JDBC importer for Elasticsearch
Apache License 2.0
2.84k stars 711 forks source link

JDBC river plugin thread exception #455

Open arunkillu opened 9 years ago

arunkillu commented 9 years ago

I am using elasticsearch "1.4.2" with river plugin on an aws instance with 8GB ram.Everything was working fine for a week but after a week the river plugin[plugin=org.xbib.elasticsearch.plugin.jdbc.river.JDBCRiverPlugin version=1.4.0.4] stopped working also I was not able to do a ssh login to the server.After server restart ssh login worked fine ,when I checked the logs of elastic search I could find this error.

[2015-01-29 09:00:59,001][WARN ][river.jdbc.SimpleRiverFlow] no river mouth [2015-01-29 09:00:59,001][ERROR][river.jdbc.RiverThread ] java.lang.OutOfMemoryError: unable to create new native thread java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: unable to create new native thread After restarting the service everything works normal .But after certain interval the same thing happen.Can anyone tell what could be the reason and solution .If any other details are required please let me know.

When I checked the number of file descriptor using

sudo ls /proc/1503/fd/ | wc -l I could see it is increasing after every time . It was 320 and it now reached 360 (keeps increasing) . and

sudo grep -E "^Max open files" /proc/1503/limits this shows 65535

nutts commented 9 years ago

Have this issue resolved? I meet the same problem but could not figure out.

arunkillu commented 9 years ago

Actually I was using unstable river plugin , I changed and now its working perfect