Progress indication during copy-data command

amplab / training-scripts

Scripts to launch cluster used for Strata

33 stars 34 forks source link

Progress indication during copy-data command #2

Open JoshRosen opened 11 years ago

JoshRosen commented 11 years ago

It would be nice if the copy-data command had some form of progress indication. This would help to determine whether the transfer is frozen or just slow.

shivaram commented 11 years ago

In the AMP Camp 3 scripts, we use hdfs fs -copyFromLocal to copy data. I don't see any flag that turn on progress reporting -- Any ideas what we could do get progress information ?