data all runs out of memory

ndmitchell / hoogle

Haskell API search engine

http://hoogle.haskell.org/

Other

738 stars 134 forks source link

data all runs out of memory #62

Open rehno-lindeque opened 10 years ago

rehno-lindeque commented 10 years ago

Just repeating the memory issue I mentioned on reddit.

$ hoogle data all
Creating dph-seq.hoo... 
Killed

It seems to me like hoogle runs out of memory with data all. Please feel free to close this immediately if it's a known issue!

ndmitchell commented 10 years ago

I think the issue is somewhat known (it happens to some people, but not all), but that doesn't mean it shouldn't be fixed! I think the basic problem is memory use is way too high, and once you are at that level, sometimes failing is inevitable. Thanks for reporting your issue to the bug tracker.

rehno-lindeque commented 10 years ago

Thanks for taking the time to investigate!

PierreR commented 10 years ago

Same here.

sudo hoogle data all
Creating data-category.hoo... 
hoogle: out of memory (requested 1048576 bytes)

I have a vm running Arch linux with 5Gig of dedicated RAM. Hoogle is the sole program running in there (I even try without starting X)

Hoogle version is 4.2.34 (ghc-7.8.3). Is there any workaround apart from increasing the available memory on the VMs ? How much ram might be expected ?

If I dare saying so, this looks quite bad ;-)

PierreR commented 10 years ago

For the record, I've eventually managed to run it with 5.3 G and with swap enabled.

carlpaten commented 9 years ago

This affects me too. :(

ndmitchell commented 9 years ago

Fixed in the in-development v5 version, where all data takes 378Mb on my machine (about 600 on a 64 bit machine)