search

Intel-bigdata / SSM

Smart Storage Management for Big Data, a comprehensive hot/cold data optimized solution
Apache License 2.0
133 stars 67 forks source link

Compress/Decompress actions lead to owner related issues #2194

Closed lipppppp closed 4 years ago

lipppppp commented 4 years ago

Hi, I found two issues about compress action. 1.The files owner is changed after compress/decompress action. It may cause permission issue. User hdfs is the admin user of SSM. image image image 2.The shell command 'chown' failed when it set to the directory which have compressed files. It seems HdfsNamedFileStatus is not subclass of LocatedFileStatus. image

PHILO-HE commented 4 years ago
  1. Please try to call dfsClient to setOwner to keep consistent ownership. You can do that in (de)CompressAction.
  2. I cannot reproduce the issue. From my analysis, HdfsNamedFileStatus cannot be created for compressed file seemingly, assuming files under that folder are correctly compressed. Please have a remote debug to see which kind of file caused this issue.
lipppppp commented 4 years ago

Thanks for @PHILO-HE 's support. PR#2195 solved this problem.

PHILO-HE commented 4 years ago

OK. Let's close this issue.