search

BLLIP / bllip-parser

BLLIP reranking parser (also known as Charniak-Johnson parser, Charniak parser, Brown reranking parser) See http://pypi.python.org/pypi/bllipparser/ for Python module.
http://bllip.cs.brown.edu/
227 stars 53 forks source link

Session crashes when loading RerankingParser.from_unified_model_dir() #70

Open pythonista0801 opened 2 years ago

pythonista0801 commented 2 years ago

I have installed NegBio, bllipparser with pip and imported the required modules including NegBioParser and RerankingParser. However, when I try to load parser = NegBioParser() the session crashes on the line rrp = RerankingParser.from_unified_model_dir(self.model_dir), the reason in logs was first NO CUDA detected. I fixed it and switched to GPU runtime. After loading all dependencies and parsers, the session crashed again... it gives no message what's wrong, I can just see some logs such as : gzip: stdout: Broken pipe. OR 2022-07-13 17:54:43.937715: W tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:39] Overriding allow_growth setting because the TF_FORCE_GPU_ALLOW_GROWTH environment variable is set. Original config value was 0. and then Kernel restarted

dmcc commented 2 years ago

Interesting! (I wasn't aware NegBio was using BLLIP Parser, but that's cool to hear)

Looks like this is the same bug as https://github.com/ncbi-nlp/NegBio/issues/52 -- my guess is that it's due to some interaction between the two projects and unfortunately I don't know much about the internals of NegBio. (BLLIP Parser was built way before there were GPU accelerators so there could easily be some issues with that? That could also be a red herring.)

Unless BLLIP Parser is busted (I just did a fresh install and it seems to work?) I suspect this issue is more on the NegBio side, I'm afraid, but either way more investigation will be needed.