Users need to understand there is an upper limit to the number of files returned by a wget script. They also need to be able to change that limit.
Ideally I don't see why the limit can't be set much higher than 1000 files. Can this be tuned at each node? If there has to be a limit the web-fe should warn on an attempt to generate a wget script for more files than the limit and allow that limit to be tuned.
Users need to understand there is an upper limit to the number of files returned by a wget script. They also need to be able to change that limit.
Ideally I don't see why the limit can't be set much higher than 1000 files. Can this be tuned at each node? If there has to be a limit the web-fe should warn on an attempt to generate a wget script for more files than the limit and allow that limit to be tuned.