search

jina-ai / examples

Jina examples and demos to help you get started
https://docs.jina.ai
Apache License 2.0
453 stars 140 forks source link

examples/southpark-search: encoder driver throws an exception, the sequel pipeline may not work properly #41

Closed alexcg1 closed 4 years ago

alexcg1 commented 4 years ago

Environment

Reproduce

Note: Already installed all prerequisite packages via pip, and downloaded data via get_data.sh

python app.py -t index -n 10000

Result

See attached error.log

Notes

I encountered the exact (I think) same error on my Manjaro install, so it's likely not an Ubuntu thing

nan-wang commented 4 years ago

hi, @alexcg1 This is fixed in the latest jina. Would you please pull the codes and give it another try?

alexcg1 commented 4 years ago

Not at my PC right now but pretty sure it's /usr/bin/python or /usr/bin/python3

Also it's a "real" install, not virtualbox or docker or anything like that. 8gb of memory. 10gb free disk space at least. Quad-core CPU which isn't being overtaxed by Jina hello-world (which runs perfectly through the docker image)

Get Outlook for Androidhttps://aka.ms/ghei36

From: Nan Wang notifications@github.com Sent: Saturday, May 16, 2020 10:05:09 PM To: jina-ai/examples examples@noreply.github.com Cc: Alex Cureton-Griffiths alexcg@outlook.com; Author author@noreply.github.com Subject: Re: [jina-ai/examples] examples/southpark-search: encoder driver throws an exception, the sequel pipeline may not work properly (#41)

hi, there. What's the output message of which python?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/jina-ai/examples/issues/41#issuecomment-629621030, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AA75FA2HUGGHYAC3MYVRTQDRRZQNLANCNFSM4NAKBBIQ.

alexcg1 commented 4 years ago

I'll check tomorrow. Thanks!

Get Outlook for Androidhttps://aka.ms/ghei36

From: Nan Wang notifications@github.com Sent: Saturday, May 16, 2020 10:09:13 PM To: jina-ai/examples examples@noreply.github.com Cc: Alex Cureton-Griffiths alexcg@outlook.com; Mention mention@noreply.github.com Subject: Re: [jina-ai/examples] examples/southpark-search: encoder driver throws an exception, the sequel pipeline may not work properly (#41)

hi, @alexcg1https://github.com/alexcg1 This is fixed in the latest jina. Would you please pull the codes and give it another try?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/jina-ai/examples/issues/41#issuecomment-629621646, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AA75FA266FOD2MTDRNQNKC3RRZQ4TANCNFSM4NAKBBIQ.

nan-wang commented 4 years ago

In the log, the exception stated that

  File "/home/alexcg/.local/lib/python3.8/site-packages/jina/executors/encoders/nlp/transformer.py", line 69, in encode
    output = self.tensor2array(extra_output[0])
IndexError: list index out of range

And this is fixed in PR-412.

alexcg1 commented 4 years ago

Quick update:

I'm now getting status messages about chunk indexer and things aren't choking so soon yet. So it looks like this bug is fixed! Woohoo!