Chapter 7: Unable to start ElasticSearch as python process from Notebook

[mwunderlich]

Information

The problem arises in chapter:

• [ ] Introduction
• [ ] Text Classification
• [ ] Transformer Anatomy
• [ ] Multilingual Named Entity Recognition
• [ ] Text Generation
• [ ] Summarization
• [X] Question Answering
• [ ] Making Transformers Efficient in Production
• [ ] Dealing with Few to No Labels
• [ ] Training Transformers from Scratch
• [ ] Future Directions

Describe the bug

Environment:

• Macbook Pro M1 with Mac OS Ventura 13.4.1
• Python 3.11

ES downloaded like this in cell 28:

url = """https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-8.9.0-darwin-x86_64.tar.gz"""
!wget -nc -q {url}
!tar -xzf elasticsearch-8.9.0-darwin-x86_64.tar.gz

When executing cell 29 to launch ES from Python, I get the following error: chown: elasticsearch-8.9.0/config/jvm.options.d: Permission denied (recursively, for all directories)

Trying to launch directly from terminal doesn't work either, even after doing a sudo chown.

To Reproduce

Steps to reproduce the behavior:

1. Download ES
2. Try run cell 29

Expected behavior

ES should start up.

[fredsh2k]

Same here, couldn't start elasticsearch from the notebook itself.

But, running sudo chown -R daemon:daemon elasticsearch-8.9.0 from the terminal, entering my password, and then executing

es_server = Popen(['elasticsearch-8.9.0/bin/elasticsearch'],
                  stdout=PIPE, stderr=STDOUT) # NOTE: without preexec_fn

worked for me.

(Environment: M1 Max Ventura 13.4.1, Python 3.9.6)