Duplicates when using multiple globs

[heikki]

This is more of a question: should there be duplicates in the results?

I'm concatenating files and trying to put certain files at the beginning and rest of them to the end. Here index.js will appear twice in the end result:

gulp.src(['app/index.js', 'app/**/*.js']).pipe(concat('all.js'));

I got around it easily by writing unique plugin:

var unique = function() {
    var files = [];
    return es.map(function(file, cb) {
        if (files.indexOf(file.path) === -1) {
            files.push(file.path);
            cb(null, file);
        } else {
            cb();
        }
    });
};

ps. gulp is awesome. I just might be able to skip the whole grunt phase :)

[heikki]

This commit mentions filtering duplicates https://github.com/wearefractal/glob-stream/commit/408ad748596639c38a374b462aa71f1e22e9e296 but combine-stream doesn't have those options.

[yocontra]

Nice find - will fix this when I get a minute by adding my own dedupe