missing documentation for setting up the service from scratch

[tobiasko]

Hi everyone,

let's try to collect all information that is need by people that want to setup a service instance (server) from scratch. Where should we collect the info? We should try to document all required steps starting from a specific std. platform (we are now starting from the Debian 11 distribution). Include checkpoints for stuff like GPU drivers etc., docker, python libs, ...

Best, Tobi

[tkschmidt]

Hi @tobiasko,

I would recomment to not start with Debian. The installation of GPU drivers is always painful and we always use ubuntu servers in combination with the provided lambdastack of lambdalabs.

You can try to make it also work on Debian, but between figuring out the correct driver for NVIDA + CUDNN + kernel is a pain in the butt, and we use this wrapper for ubuntu for it.

Best,

Tobi

[tkschmidt]

I can provide a minimal ansible script to automatize it if you want it

[tkschmidt]

@tobiasko Please check https://github.com/wilhelm-lab/dlomix-serving/pull/19 . What else would you require as information?

[tobiasko]

@tkschmidt I will have a look! Should I ask our sys admin to give input? He did the painful job of installing the GPU drivers etc.

[tobiasko]

And he was successful using Debian 11. ;-)

[tkschmidt]

I'm happy to here that it worked out for him. Please provide his installation guide after https://github.com/wilhelm-lab/dlomix-serving/pull/19 is merged

[tobiasko]

okidoki!