alibaba / DataX

DataX是阿里云DataWorks数据集成的开源版本。
Other
15.77k stars 5.4k forks source link

你们的datax是否也有这个问题 【HDFS报错】 DataXceiver error processing WRITE_BLOCK operation #1448

Open gongzh021 opened 2 years ago

gongzh021 commented 2 years ago

2022-07-16 17:13:43,182 ERROR [DataXceiver for client DFSClient_attempt_1657804987000_15524_m_0000400-1450386456_1 at /172.16.9.143:36326 [Receiving block BP-12047675-172.16.9.141-1608793845868:blk_1152735511_79014410]] org.apache.hadoop.hdfs.server.datanode.DataNode: hadoop-dn004:50010:DataXceiver error processing WRITE_BLOCK operation src: /172.16.9.143:36326 dst: /172.16.9.142:50010 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:748) 2022-07-16 17:14:14,950 INFO [DataXceiver for client DFSClient_attempt

hwfbest commented 1 year ago

解决没,我也遇到这个问题