Anyscale/ray-llm:latest does not contain the serve_configs folder and models/continuous_batching/quantization folders

[WinsonSou]

(base) ray@rayllm-head-2tk98:~$ ls -larth
total 72K
-rwxr-xr-x. 1 root root   913 Dec 31  1999 run-vscode-server.sh
-rwxr-xr-x. 1 root root   822 Dec 31  1999 configure-bashrc.sh
-rw-------. 1 root root    42 Dec 31  1999 .boto
-rw-r--r--. 1 ray  users  807 Feb 25  2020 .profile
-rw-r--r--. 1 ray  users  220 Feb 25  2020 .bash_logout
drwxr-xr-x. 1 root root    17 Oct 16 15:47 ..
-rw-r--r--. 1 ray  users    0 Oct 16 15:47 .sudo_as_admin_successful
drwxr-xr-x. 2 ray  users   30 Oct 16 15:47 .conda
drwxr-xr-x. 1 ray  users   53 Oct 16 15:48 anaconda3
-rw-r--r--. 1 root root   12K Oct 16 15:54 requirements_compiled_py37.txt
-rw-r--r--. 1 root root   13K Oct 16 15:54 requirements_compiled.txt
drwxr-xr-x. 1 root root   114 Oct 16 15:55 .whl
-rw-r--r--. 1 ray  users 4.1K Oct 16 15:56 pip-freeze.txt
drwxr-xr-x. 4 ray  users   32 Oct 16 17:34 .awscliv2
-rw-r--r--. 1 ray  users 4.3K Oct 16 17:34 .bashrc
-rw-r--r--. 1 ray  users  165 Oct 16 17:34 .wget-hsts
drwxr-xr-x. 3 ray  users   38 Oct 16 17:34 .vscode-hosted-server
drwxr-xr-x. 2 ray  users   43 Oct 27 15:30 dist
drwxr-xr-x. 1 ray  users   23 Oct 27 15:30 models
drwxr-xr-x. 1 ray  users   27 Jan  9 03:50 .
-rw-------. 1 ray  users   17 Jan  9 03:51 .bash_history

[JGSweets]

@WinsonSou I noticed it was because it is not using its latest deployment. latest was not actually latest and is more like~0.3.0`.

this has since been fixed: https://github.com/ray-project/ray-llm/issues/122

[WinsonSou]

Thank you! I’ll go ahead and close it. Thank you @JGSweets and @sihanwang41