uvagfx / hipi

HIPI: Hadoop Image Processing Interface
http://hipi.cs.virginia.edu
BSD 3-Clause "New" or "Revised" License
133 stars 82 forks source link

hibImport with too many pictures #30

Open yangboz opened 8 years ago

yangboz commented 8 years ago

(total number of 25000, throw error at 10256), Exception in thread "main" java.lang.NullPointerException at org.hipi.imagebundle.HipiImageBundle.addImage(HipiImageBundle.java:634) at org.hipi.tools.HibImport.main(HibImport.java:136) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

yangboz commented 8 years ago

Maybe the root cause is here:

BufferedInputStream bufferedInputStream = new BufferedInputStream(inputStream);

> bufferedInputStream.mark(Integer.MAX_VALUE); // 100MB

    HipiImageHeader header = decoder.decodeHeader(bufferedInputStream);
    if (metaData != null) {
      header.setMetaData(metaData);
    }
    bufferedInputStream.reset();
    addImage(header, bufferedInputStream);