The current implementation always reads the whole input before decoding. This causes problems with large files, e.g.: zcat larget_file.gz | unidecode | head will take much longer and use more memory than necessary.
This PR will change this by reading the input line by line. This makes it also possible to use the script with unbuffered stdin and stdout streams.
avian2
commented
2 years ago
The current implementation always reads the whole input before decoding. This causes problems with large files, e.g.:
zcat larget_file.gz | unidecode | headwill take much longer and use more memory than necessary.This PR will change this by reading the input line by line. This makes it also possible to use the script with unbuffered stdin and stdout streams.