I was copying a TB or two of data and it choked on a "named pipe" file, issued an error message, and after that the status display only incremented the Elapsed time field and none of the other fields. The copy operation appears to be continuing but the status display is not being updated. The iotop command suggests the disk copy speeds have dropped to a few MB/sec, down from several hundred MB/sec to start. The data includes a large number of small files, which can slow things down, and atop says the source md0 disk array is at busy 101% for read operations.
Also: I note that the error message does not include the name of the program issuing it. We sysadmin hate tracking down that sort of unidentified error message in our log files and cron jobs. Please consider adding argv[0] to the start of all program messages.
I was copying a TB or two of data and it choked on a "named pipe" file, issued an error message, and after that the status display only incremented the Elapsed time field and none of the other fields. The copy operation appears to be continuing but the status display is not being updated. The
iotopcommand suggests the disk copy speeds have dropped to a few MB/sec, down from several hundred MB/sec to start. The data includes a large number of small files, which can slow things down, andatopsays the sourcemd0disk array is atbusy 101%forreadoperations.Also: I note that the error message does not include the name of the program issuing it. We sysadmin hate tracking down that sort of unidentified error message in our log files and cron jobs. Please consider adding
argv[0]to the start of all program messages.