org.streams.commons.file.WriterException: java.io.IOException: write beyond end of stream


see 
http://lucene.472066.n3.nabble.com/LzoCodec-not-working-correctly-td648214.html

Hi, 

I changed LzoCompressor.finished() from: 

  public synchronized boolean finished() { 
    // ... 
    return (finished && compressedDirectBuf.remaining() == 0); 
  } 

to: 

 public synchronized boolean finished() { 
    // ... 
    return (finish && compressedDirectBuf.remaining() == 0); 
  } 

org.streams.commons.file.WriterException: java.io.IOException: write beyond end 
of stream
    at com.hadoop.compression.lzo.LzopOutputStream.write(LzopOutputStream.java:115)
    at org.streams.commons.file.RollBackOutputStream.write(RollBackOutputStream.java:144)
    at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1026)
    at org.apache.commons.io.IOUtils.copy(IOUtils.java:999)
    at org.streams.collector.write.impl.LocalLogFileWriter.write(LocalLogFileWriter.java:129)
    at org.streams.collector.server.impl.LogWriterHandler.writeToFile(LogWriterHandler.java:372)
    at org.streams.collector.server.impl.LogWriterHandler.access$100(LogWriterHandler.java:48)
    at org.streams.collector.server.impl.LogWriterHandler$1.inSync(LogWriterHandler.java:229)
    at org.streams.collector.server.impl.LogWriterHandler$1.inSync(LogWriterHandler.java:192)
    at org.streams.commons.file.impl.CoordinationServiceClientImpl$1.call(CoordinationServiceClientImpl.java:72)
    at org.streams.commons.zookeeper.ZLock.withLock(ZLock.java:92)
    at org.streams.commons.file.impl.CoordinationServiceClientImpl.withLock(CoordinationServiceClientImpl.java:59)
    at org.streams.collector.server.impl.LogWriterHandler.messageReceived(LogWriterHandler.java:189)
    at org.streams.commons.metrics.impl.MetricChannel.messageReceived(MetricChannel.java:90)
    at org.jboss.netty.handler.timeout.ReadTimeoutHandler.messageReceived(ReadTimeoutHandler.java:186)
    at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:302)
    at org.jboss.netty.handler.codec.replay.ReplayingDecoder.unfoldAndfireMessageReceived(ReplayingDecoder.java:525)
    at org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:506)
    at org.jboss.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:443)
    at org.streams.collector.server.impl.IpFilterHandler.handleUpstream(IpFilterHandler.java:121)
    at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:274)
    at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:261)
    at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:349)
    at org.jboss.netty.channel.socket.nio.NioWorker.processSelectedKeys(NioWorker.java:280)
    at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:200)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:619)

  public synchronized boolean finished() { 
    // ... 
    return (finish && compressedDirectBuf.remaining() == 0); 
  }
Original issue reported on code.google.com by gerritjvv@gmail.com on 1 Aug 2011 at 9:20
shreedharcva / bigstreams

org.streams.commons.file.WriterException: java.io.IOException: write beyond end of stream #59
