search

YAMJ / yamj-v2

Yet Another Movie Jukebox (YAMJ) v2
GNU General Public License v3.0
28 stars 11 forks source link

Too many open files when scanning large video database (more than 700) #1409

Closed Omertron closed 9 years ago

Omertron commented 9 years ago

Original issue 1410 created by Omertron on 2010-04-07T16:19:18.000Z:

What steps will reproduce the problem?

  1. Having a very wide database :)
  2. Scan it 3.

What version of YAMJ are you using? On what operating system? 1.9 on linux/debian using JRE1.6

What device are you using YAMJ on? Networked Media Tank, PlayonHD, Other? Popcorn Houer

Please provide any additional information below.

After a while at scanning my series YAMJ crash

ERROR: TheMovieDb API -> Too many open files GooglePosterPlugin: Failed retreiving poster URL from google images : .... Error : Too many open files YahooPosterPlugin : Failed retreiving poster URL from yahoo images : .... Error : Too many open files Failed copying file ./skins/default/resources/dummy.jpg to ./temp/videos/Jukebox/.... java.io.FileNotFoundException: ./skins/default/resources/dummy.jpg (Too many open files)

Finished: ... (787/1260) Updating data for: ... java.io.IOException: Cannot run program "./mediainfo" (in directory "./mediaInfo"): java.io.IOException: error=24, Too many open files at java.lang.ProcessBuilder.start(ProcessBuilder.java:459) at com.moviejukebox.scanner.MediaInfoScanner.scan(MediaInfoScanner.java:185) at com.moviejukebox.scanner.MediaInfoScanner.scan(MediaInfoScanner.java:166) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1065) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:657) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:649) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619) Caused by: java.io.IOException: java.io.IOException: error=24, Too many open files at java.lang.UNIXProcess.<init>(UNIXProcess.java:148) at java.lang.ProcessImpl.start(ProcessImpl.java:65) at java.lang.ProcessBuilder.start(ProcessBuilder.java:452) ... 10 more

And it eventually trigger some error in the jvm herself:

# A fatal error has been detected by the Java Runtime Environment:
#
#  Internal Error (exceptions.cpp:364), pid=8157, tid=139681323669776
#  Error: ExceptionMark destructor expects no pending exceptions
#
# JRE version: 6.0_17-b04
# Java VM: Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode linux-amd64 )
# Can not save log file, dump to screen..
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  Internal Error (exceptions.cpp:364), pid=8157, tid=139681323669776
#  Error: ExceptionMark destructor expects no pending exceptions
#
# JRE version: 6.0_17-b04
# Java VM: Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode linux-amd64 )
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
#

There must be some unclosed file handles
Omertron commented 9 years ago

Comment #1 originally posted by Omertron on 2010-04-07T21:48:04.000Z:

This is a useful link http://lj4newbies.blogspot.com/2007/04/too-many-open-files.html

But also try r1582 to see if that solves the issue as well

Omertron commented 9 years ago

Comment #2 originally posted by Omertron on 2010-05-10T20:43:55.000Z:

<empty>