search

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
213 stars 82 forks source link

Got some deprecation notice, might update these #72

Closed nerdylive123 closed 2 months ago

nerdylive123 commented 3 months ago

2024-05-23T09:58:01.432712734Z CUDA Version 12.1.0 2024-05-23T09:58:01.433425080Z 2024-05-23T09:58:01.433427258Z Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. 2024-05-23T09:58:01.434084437Z 2024-05-23T09:58:01.434087212Z This container image and its contents are governed by the NVIDIA Deep Learning Container License. 2024-05-23T09:58:01.434089552Z By pulling and using the container, you accept the terms and conditions of this license: 2024-05-23T09:58:01.434091167Z https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license 2024-05-23T09:58:01.434092825Z 2024-05-23T09:58:01.434094209Z A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience. 2024-05-23T09:58:01.442413442Z 2024-05-23T09:58:01.442446959Z 2024-05-23T09:58:01.442461039Z DEPRECATION NOTICE! 2024-05-23T09:58:01.442644921Z

  1. 2024-05-23T09:58:01.442672640Z THIS IMAGE IS DEPRECATED and is scheduled for DELETION. 2024-05-23T09:58:01.442684090Z https://gitlab.com/nvidia/container-images/cuda/blob/master/doc/support-policy.md

2024-05-23T09:58:01.442696513Z

  1. 2024-05-23T09:58:05.243818005Z /usr/local/lib/python3.10/dist-packages/huggingface_hub/file_download.py:1132: FutureWarning: resume_download is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use force_download=True. ..
alpayariyak commented 2 months ago

First one is not a problem, second one is stemming from vLLM - will likely be fixed soon