search

Intel-bigdata / SSM

Smart Storage Management for Big Data, a comprehensive hot/cold data optimized solution
Apache License 2.0
133 stars 67 forks source link

A lot of error DeleteFile Action fails, file doesn't exist! #2253

Open stanislav-gabdulgaziev opened 2 years ago

stanislav-gabdulgaziev commented 2 years ago

I put rule: file : path matches "/tmp/dr-test/*" | sync -dest hdfs://tla-tst-2.ru-central1.internal:8020//tmp/dr-test

Copying to a remote cluster works but there are a lot of errors like this: Action starts at Tue May 24 15:08:56 UTC 2022 : Delete hdfs://tla-tst-2.ru-central1.internal:8020//tmp/dr-test/SSM/supports/integration-test/test_mover.py.COPYING org.smartdata.action.ActionException: DeleteFile Action fails, file doesn't exist! at org.smartdata.hdfs.action.DeleteFileAction.deleteFile(DeleteFileAction.java:77) at org.smartdata.hdfs.action.DeleteFileAction.execute(DeleteFileAction.java:65)

In logfile: ERROR [pool-19-thread-4] (SmartAction.java:134) - SmartAction execute error org.smartdata.action.ActionException: DeleteFile Action fails, file doesn't exist! at org.smartdata.hdfs.action.DeleteFileAction.deleteFile(DeleteFileAction.java:77) ~[smart-hadoop-1.6.0-SNAPSHOT.jar:?] at org.smartdata.hdfs.action.DeleteFileAction.execute(DeleteFileAction.java:65) ~[smart-hadoop-1.6.0-SNAPSHOT.jar:?] at org.smartdata.action.SmartAction.run(SmartAction.java:131) [smart-action-1.6.0-SNAPSHOT.jar:?] at org.smartdata.server.engine.cmdlet.Cmdlet.runAllActions(Cmdlet.java:104) [smart-engine-1.6.0-SNAPSHOT.jar:?] at org.smartdata.server.engine.cmdlet.Cmdlet.run(Cmdlet.java:125) [smart-engine-1.6.0-SNAPSHOT.jar:?]

For example hdfs dfs -put original-ks.cfg /tmp/dr-test Error1

The file was copy good, but then we have errors like Error2