lmql compatibility with lambda server (update needed?)

[alysawyer]

Hi Mike, We are trying to install lmql on the lamda server however I think the server needs to be updated to 3.10 in order for it to be compatible, is that something that you would be able to do?

[mikeizbicki]

Hmmm... I forgot that lmql required a newer version of python. This is "trivial" to fix (by which I mean if everything goes well, you'll be done in <5 minutes, but could take a couple of hours if you run into a hiccup). You can update your version of python on the lambda server by following the instructions here: https://realpython.com/intro-to-pyenv/#using-the-pyenv-installer

[nliyanage]

hi mike -

thanks for getting back to us!

we tried this, but we got the "command pyenv not found" error when we got to that portion of the tutorial. currently doing some stackoverflow troubleshooting, but any other tips/tricks/thoughts?

thanks:)!

[nliyanage]

oops nvm, ignore earlier message about command not found - figured that out!

also for people that aren't in the call right now - we chose 3.10.11 (just in case it matters that we all choose the same version)

[irajmoradi]

Hello,

Some have been able to get it to work, but for others running

pyenv install -v 3.10.11

leads to the output

 File "/tmp/python-build.20230524101022.26850/Python-3.10.11/Lib/threading.py", line 935, in start
    _start_new_thread(self._bootstrap, ())
RuntimeError: can't start new thread
Makefile:637: recipe for target 'sharedmods' failed
make: *** [sharedmods] Error 1

BUILD FAILED (Ubuntu 18.04 using python-build 20180424)

Inspect or clean up the working tree at /tmp/python-build.20230524101022.26850
Results logged to /tmp/python-build.20230524101022.26850.log

Last 10 log lines:
    futures = [executor.submit(self.build_extension, ext)
  File "/tmp/python-build.20230524101022.26850/Python-3.10.11/Lib/concurrent/futures/thread.py", line 176, in submit
    self._adjust_thread_count()
  File "/tmp/python-build.20230524101022.26850/Python-3.10.11/Lib/concurrent/futures/thread.py", line 199, in _adjust_thread_count
    t.start()
  File "/tmp/python-build.20230524101022.26850/Python-3.10.11/Lib/threading.py", line 935, in start
    _start_new_thread(self._bootstrap, ())
RuntimeError: can't start new thread
Makefile:637: recipe for target 'sharedmods' failed
make: *** [sharedmods] Error 1

[mikeizbicki]

@irajmoradi This is likely due to CS46 accounts having had some extra restrictions on them. I've removed these restrictions. You'll probably have to logout/login for the updated settings to take affect.

[irajmoradi]

I logged back out and in, and had to repath pyenv, then I ran the command again and got the same error.

edit: by repath I mean I had to do the following commands again to get pyenv to show up as a command

export PATH="$HOME/.pyenv/bin:$PATH"
eval "$(pyenv init -)"
eval "$(pyenv virtualenv-init -)"

[sophiahuangg]

Hi Mike! Lucas and I are also having a permission denied issue. Would it be possible to have these restrictions removed for us as well? Thank you!

[mikeizbicki]

I previously removed all restrictions on anyone's account that don't also exist on my account. So that shouldn't be a problem for getting python installed.

FWIW, here's my version numbers:

lambda-server:~ (master) $ python3 --version
Python 3.10.10
lambda-server:~ (master) $ pyenv --version
pyenv 2.3.13

[lwelch25]

Hi Mike! Iraj, Nethmin, and I are still having issues with installing the new version of python. These are the commands in order:

1. curl https://pyenv.run | bash
2. export PATH="$HOME/.pyenv/bin:$PATH"
eval "$(pyenv init -)"
eval "$(pyenv virtualenv-init -)"
3. pyenv install -v 3.10.11
4. pyenv global 3.10.11

We keep getting these error messages after the installation process:

BUILD FAILED (Ubuntu 18.04 using python-build 20180424)

Inspect or clean up the working tree at /tmp/python-build.20230524135514.27542
Results logged to /tmp/python-build.20230524135514.27542.log

Last 10 log lines:
    futures = [executor.submit(self.build_extension, ext)
  File "/tmp/python-build.20230524135514.27542/Python-3.10.11/Lib/concurrent/futures/thread.py", line 176, in submit
    self._adjust_thread_count()
  File "/tmp/python-build.20230524135514.27542/Python-3.10.11/Lib/concurrent/futures/thread.py", line 199, in _adjust_thread_count
    t.start()
  File "/tmp/python-build.20230524135514.27542/Python-3.10.11/Lib/threading.py", line 935, in start
    _start_new_thread(self._bootstrap, ())
RuntimeError: can't start new thread
Makefile:637: recipe for target 'sharedmods' failed
make: *** [sharedmods] Error 1

lambda-server:~ (master %) $ pyenv global 3.10.11
pyenv: version `3.10.11' not installed

I've personally tried freeing up system resources, trying to install another Python version, trying reinstalling after a system update, and increasing the maximum number of threads (don't have root access).

How can we fix this issue so we can download the new version of python? Or is there another method? Thank you!