search

lwhay / hyracks

Automatically exported from code.google.com/p/hyracks
Apache License 2.0
0 stars 1 forks source link

currency (too many files open) error #108

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
When the ulimit of open files is set to 1024 on the slaves I get the following 
error,

PageRank example with webmap data: 

Listening for transport dt_socket at address: 7002
Exception in thread "pool-1-thread-1" java.lang.InternalError
        at java.util.Currency$1.run(Currency.java:224)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.util.Currency.<clinit>(Currency.java:192)
        at java.text.DecimalFormatSymbols.initialize(DecimalFormatSymbols.java:585)
        at java.text.DecimalFormatSymbols.<init>(DecimalFormatSymbols.java:94)
        at java.text.DecimalFormatSymbols.getInstance(DecimalFormatSymbols.java:157)
        at java.text.NumberFormat.getInstance(NumberFormat.java:767)
        at java.text.NumberFormat.getNumberInstance(NumberFormat.java:407)
        at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:47)
        at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:721)
        at org.apache.hadoop.security.UnixUserGroupInformation.readFromConf(UnixUserGroupInformation.java:206)
        at org.apache.hadoop.security.UserGroupInformation.readFrom(UserGroupInformation.java:123)
        at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1446)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1387)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
        at edu.uci.ics.pregelix.dataflow.util.IterationUtils.writeGlobalAggregateValue(IterationUtils.java:113)
        at edu.uci.ics.pregelix.dataflow.FinalAggregateOperatorDescriptor$1.close(FinalAggregateOperatorDescriptor.java:99)
        at edu.uci.ics.hyracks.control.nc.Task.pushFrames(Task.java:327)
        at edu.uci.ics.hyracks.control.nc.Task.run(Task.java:269)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)
Caused by: java.io.FileNotFoundException: 
/pkg/java/1.7.0_15/jre/lib/currency.data (Too many open files)
        at java.io.FileInputStream.open(Native Method)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at java.io.FileInputStream.<init>(FileInputStream.java:97)
        at java.util.Currency$1.run(Currency.java:198)
        ... 22 more
Exception in thread "pool-1-thread-19" java.lang.NoClassDefFoundError: Could 
not initialize class java.util.Currency
        at java.text.DecimalFormatSymbols.initialize(DecimalFormatSymbols.java:566)
        at java.text.DecimalFormatSymbols.<init>(DecimalFormatSymbols.java:94)
        at java.text.DecimalFormatSymbols.getInstance(DecimalFormatSymbols.java:157)
        at java.text.NumberFormat.getInstance(NumberFormat.java:767)
        at java.text.NumberFormat.getInstance(NumberFormat.java:384)
        at org.apache.hadoop.mapreduce.TaskID.<clinit>(TaskID.java:50)
        at org.apache.hadoop.mapreduce.TaskAttemptID.<init>(TaskAttemptID.java:76)
        at edu.uci.ics.pregelix.runtime.touchpoint.RuntimeHookFactory$1.configure(RuntimeHookFactory.java:49)
        at edu.uci.ics.pregelix.dataflow.util.FunctionProxy.functionOpen(FunctionProxy.java:67)
        at edu.uci.ics.pregelix.dataflow.std.BTreeSearchFunctionUpdateOperatorNodePushable.open(BTreeSearchFunctionUpdateOperatorNodePushable.java:112)
        at edu.uci.ics.pregelix.dataflow.std.RuntimeHookOperatorDescriptor$1.open(RuntimeHookOperatorDescriptor.java:49)
        at edu.uci.ics.pregelix.dataflow.EmptyTupleSourceOperatorDescriptor$1.initialize(EmptyTupleSourceOperatorDescriptor.java:48)
        at edu.uci.ics.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:81)
        at edu.uci.ics.hyracks.control.nc.Task.run(Task.java:233)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)

Setting the ulimit higher solves the problem. 

Vishal

Original issue reported on code.google.com by write2vi...@gmail.com on 19 May 2013 at 8:31