mntnr / name-your-contributors

Name your GitHub contributors; get commits, issues, and comments
MIT License
73 stars 20 forks source link

"process out of memory" error #15

Closed jywarren closed 7 years ago

jywarren commented 8 years ago

Hi, really interested in using the lib, thanks! Got this error, though, after hanging for a few minutes:

(trusty)warren@localhost:~/sites/plots2$ name-your-contributors ipfs --since=2016-10-15T00:20:24Z
Got response
wrote issue_creators
wrote issue_commenters

<--- Last few GCs --->

  403290 ms: Mark-sweep 701.8 (738.5) -> 699.6 (738.5) MB, 8779.9 / 0 ms [allocation failure] [GC in old space requested].
  413027 ms: Mark-sweep 699.6 (738.5) -> 699.6 (738.5) MB, 9736.6 / 0 ms [allocation failure] [GC in old space requested].
  429222 ms: Mark-sweep 699.6 (738.5) -> 698.8 (738.5) MB, 16195.4 / 13 ms [last resort gc].
  441528 ms: Mark-sweep 698.8 (738.5) -> 697.9 (738.5) MB, 12302.8 / 0 ms [last resort gc].

<--- JS stacktrace --->

==== JS stack trace =========================================

Security context: 0x29d65341 <JS Object>
    1: /* anonymous */(aka /* anonymous */) [/home/warren/.nvm/versions/node/v4.4.0/lib/node_modules/name-your-contributors/node_modules/octokat/dist/node/verb-methods.js:79] [pc=0x25676570] (this=0x29d080dd <undefined>,verbFunc=0x47f8f695 <JS Function module.exports.SimpleVerbs.verbs.create (SharedFunctionInfo 0x3a6b53e5)>,verbName=0x29d25431 <String[6]: create>)
    2: injectVerbMethods [/home/wa...

FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - process out of memory
Aborted (core dumped)
jywarren commented 8 years ago

That looks like a lot of data for just the past couple weeks of data; any ideas?

RichardLitt commented 7 years ago

Hey! Sorry for the massive delay getting back to you on this. Currently on vacation // hacking in Japan, haven't had much time. I think we've fixed this issue elsewhere, but I'm not sure I merged it in. Give me a couple of days to take a look at it.

daviddias commented 7 years ago

Just encountered the same problem FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - JavaScript heap out of memory. You might want to consider to have some sort of streaming data parsing to having running into situations like these.

RichardLitt commented 7 years ago

Can you give me your command so I can test it?

jywarren commented 7 years ago

I'm using:

var nameYourContributors = require('name-your-contributors');

nameYourContributors('ipfs', {
  since: '2016-12-01T00:00:00Z'
});

with prepended env variables in the node nyc.js. Thanks!

jywarren commented 7 years ago

But also the above-referenced direct CLI method:

(trusty)warren@localhost:~/$ name-your-contributors ipfs --since=2016-10-15T00:20:24Z
RichardLitt commented 7 years ago

Hey! So! I found @tgetgood, and with his help, this issue is no longer an issue! 🎉

This should now be fixed as of 3.0.0, which uses GraphQL to stop all overfetching issues.

@jywarren Try it again? @diasdavid Feel free to use it for IPFS, too. :)

jywarren commented 7 years ago

This works great now. Thanks!

On Mon, Oct 9, 2017 at 10:38 AM, Richard Littauer notifications@github.com wrote:

Hey! So! I found @tgetgood https://github.com/tgetgood, and with his help, this issue is no longer an issue! 🎉

This should now be fixed as of 3.0.0, which uses GraphQL to stop all overfetching issues.

@jywarren https://github.com/jywarren Try it again? @diasdavid https://github.com/diasdavid Feel free to use it for IPFS, too. :)

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/RichardLitt/name-your-contributors/issues/15#issuecomment-335178207, or mute the thread https://github.com/notifications/unsubscribe-auth/AABfJ47rvSXG0Wp817LpaDA6fJUTWSKRks5sqi_4gaJpZM4KkQUd .