When syncing a very large number of files (over 12k), get "Maximum call stack size exceeded"

TritonDataCenter / node-manta-sync

Rsync style command for Joyent's Manta

31 stars 9 forks source link

When syncing a very large number of files (over 12k), get "Maximum call stack size exceeded" #3

Closed sax closed 10 years ago

sax commented 10 years ago

util.js:35
  var str = String(f).replace(formatRegExp, function(x) {
                      ^
RangeError: Maximum call stack size exceeded

@bixu @sax

bahamas10 commented 10 years ago

hm, very interesting. this error is coming from util.js, which is builtin to node itself (most likely util.format, which is called by console.log, console.error, etc.).

Can you send the full command you are trying to run (you don't have to include the directories, just the options you started manta-sync with. Also, the version of manta-sync you are using with manta-sync -v?

bahamas10 commented 10 years ago

I'm worried this may be caused by the async module not releasing control back to the event loop. If this is actually the case, I may have to look into implementing a different flow control module in its place.

https://github.com/caolan/async/issues/267

bahamas10 commented 10 years ago

fixed in v0.0.6