arpieb / verbnet

Elixir package to provide fast lookups into VerbNet data for NLP solutions.
https://hexdocs.pm/verbnet
Apache License 2.0
1 stars 1 forks source link

Crash dump is being written .. #1

Closed rodriguesfas closed 5 years ago

rodriguesfas commented 5 years ago

I'm having the following result when I try to run, am I doing something rrado? Could someone help me?

==> verbnet Compiling 2 files (.ex) Compiling VerbNet XML to static lookups takes a while... Processing 498 parsed VerbNet classes Processing 21436 VerbNet frames Codified VerbNet classes in 1342ms Generated verbnet app ==> verbnet Compiling 1 file (.ex) Generated verbnet app eheap_alloc: Cannot allocate 8162366936 bytes of memory (of type "heap").

Crash dump is being written to: erl_crash.dump... done

arpieb commented 5 years ago

Sorry, just now saw this - not sure why I didn't get a notification from GH. I'll look into it ASAP! What version of Elixir and Erlang are you running, and what OS?

Thanks!

arpieb commented 5 years ago

Tested a build on my local:

$ mix clean ; mix compile
Compiling 2 files (.ex)
Compiling VerbNet XML to static lookups takes a while...
Processing 498 parsed VerbNet classes
Processing 21436 VerbNet frames
Codified VerbNet classes in 2815ms
Generated verbnet app

$ elixir --version
Erlang/OTP 21 [erts-10.1.1] [source] [64-bit] [smp:24:24] [ds:24:24:10] [async-threads:1] [hipe] [dtrace]

Elixir 1.7.3 (compiled with Erlang/OTP 21)

Only thing I can think of is you're running out of memory during compilation of the lookup tables. In addition to the information requested above, could you also let me know how much memory you have? I can then test on a VM with restricted memory to see if that's the issue.

Thanks!

rodriguesfas commented 5 years ago

I have 16GB of RAM. This is enough?

Em qua, 24 de out de 2018 às 21:59, Robert Bates notifications@github.com escreveu:

Tested a build on my local:

$ mix clean ; mix compile Compiling 2 files (.ex) Compiling VerbNet XML to static lookups takes a while... Processing 498 parsed VerbNet classes Processing 21436 VerbNet frames Codified VerbNet classes in 2815ms Generated verbnet app

$ elixir --version Erlang/OTP 21 [erts-10.1.1] [source] [64-bit] [smp:24:24] [ds:24:24:10] [async-threads:1] [hipe] [dtrace]

Elixir 1.7.3 (compiled with Erlang/OTP 21)

Only thing I can think of is you're running out of memory during compilation of the lookup tables. In addition to the information requested above, could you also let me know how much memory you have? I can then test on a VM with restricted memory to see if that's the issue.

Thanks!

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/arpieb/verbnet/issues/1#issuecomment-432877099, or mute the thread https://github.com/notifications/unsubscribe-auth/AEyzIAA0UgTJkpVwM54mAQuiEduauAvGks5uoQzTgaJpZM4W1EPA .

-- Francisco Rodrigues

Candidate Master in Computer Science UFPE CIn Specialist in MBA Teaching Higher Education - IDJ Graduated in Industrial Automation Technology - IFCE Juazeiro Technologist in Analysis and Development of Systems - UniLeão


-- INFORMAÇÃO CONFIDENCIAL / CONFIDENTIALITY NOTICE - Esta mensagem Eletrônica e arquivos anexos contêm informações privilegiadas e confidenciais. O uso não autorizado é ilegal, resultando em responsabilidade civil e criminal. Se você não é o destinatário correto, por favor notificar o remetente e apagar a mensagem inteira. / This electronic transmission is strictly confidential, intended solely for the addressee, and may contain confidential and/or privileged material. Any disclosure, copying, distribution or action taken in reliance on it is prohibited and may be unlawful, resulting in full civil and criminal responsability. If you receive this in error, please contact the sender and delete the material from any computer.

rodriguesfas commented 5 years ago

I think I'm doing something wrong, would you have a detailed step-by-step how to install and use verbnet for those who are not familiar with Erlang and / or Elixir?

Em qui, 25 de out de 2018 às 07:53, Francisco Rodrigues < franciscosouzaacer@gmail.com> escreveu:

I have 16GB of RAM. This is enough?

Em qua, 24 de out de 2018 às 21:59, Robert Bates notifications@github.com escreveu:

Tested a build on my local:

$ mix clean ; mix compile Compiling 2 files (.ex) Compiling VerbNet XML to static lookups takes a while... Processing 498 parsed VerbNet classes Processing 21436 VerbNet frames Codified VerbNet classes in 2815ms Generated verbnet app

$ elixir --version Erlang/OTP 21 [erts-10.1.1] [source] [64-bit] [smp:24:24] [ds:24:24:10] [async-threads:1] [hipe] [dtrace]

Elixir 1.7.3 (compiled with Erlang/OTP 21)

Only thing I can think of is you're running out of memory during compilation of the lookup tables. In addition to the information requested above, could you also let me know how much memory you have? I can then test on a VM with restricted memory to see if that's the issue.

Thanks!

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/arpieb/verbnet/issues/1#issuecomment-432877099, or mute the thread https://github.com/notifications/unsubscribe-auth/AEyzIAA0UgTJkpVwM54mAQuiEduauAvGks5uoQzTgaJpZM4W1EPA .

-- Francisco Rodrigues

Candidate Master in Computer Science UFPE CIn Specialist in MBA Teaching Higher Education - IDJ Graduated in Industrial Automation Technology - IFCE Juazeiro Technologist in Analysis and Development of Systems - UniLeão


-- INFORMAÇÃO CONFIDENCIAL / CONFIDENTIALITY NOTICE - Esta mensagem Eletrônica e arquivos anexos contêm informações privilegiadas e confidenciais. O uso não autorizado é ilegal, resultando em responsabilidade civil e criminal. Se você não é o destinatário correto, por favor notificar o remetente e apagar a mensagem inteira. / This electronic transmission is strictly confidential, intended solely for the addressee, and may contain confidential and/or privileged material. Any disclosure, copying, distribution or action taken in reliance on it is prohibited and may be unlawful, resulting in full civil and criminal responsability. If you receive this in error, please contact the sender and delete the material from any computer.

-- Francisco Rodrigues

Candidate Master in Computer Science UFPE CIn Specialist in MBA Teaching Higher Education - IDJ Graduated in Industrial Automation Technology - IFCE Juazeiro Technologist in Analysis and Development of Systems - UniLeão


-- INFORMAÇÃO CONFIDENCIAL / CONFIDENTIALITY NOTICE - Esta mensagem Eletrônica e arquivos anexos contêm informações privilegiadas e confidenciais. O uso não autorizado é ilegal, resultando em responsabilidade civil e criminal. Se você não é o destinatário correto, por favor notificar o remetente e apagar a mensagem inteira. / This electronic transmission is strictly confidential, intended solely for the addressee, and may contain confidential and/or privileged material. Any disclosure, copying, distribution or action taken in reliance on it is prohibited and may be unlawful, resulting in full civil and criminal responsability. If you receive this in error, please contact the sender and delete the material from any computer.

arpieb commented 5 years ago

Yeah, 16G should be plenty. I just created a new mix project, added the dependency for verbnet, some functions in the boilerplate module code to call several VerbNet module functions - and it appears to work fine... The VM I used only has 4G of memory allocated, so even less than what you've got.

If you're new to Elixir, the easiest way to create new projects is to use the mix tool which stubs out a lot of the directory structure and build config (https://hexdocs.pm/mix/Mix.html). If you've already gone that route, then it may just be a matter of an error somewhere in your build config.

That being said, could you provide a copy of your mix.exs file and the output from elixir --version so I can see what you're working with? Maybe something in there will give me a clue without having to see the entire codebase.

arpieb commented 5 years ago

@rodriguesfas just following up to see if you're still having trouble compiling or using the module...