bpkapkar
commented
1 week ago It was great having you as a speaker @VishnuVardhanSaiLanka, and we hope to see you at our upcoming meetups. The topic was already presented in the June meetup, so we are ready to close this issue.
Title of the talk/workshop Deploying ML Models at Scale: Autoscaling with Ray.io and Kuberay
Abstract of the talk/workshop In the realm of large-scale machine learning (ML) deployments, the ability to dynamically scale resources to meet varying workloads is essential for optimizing performance and efficiency. This presentation delves into the strategies and technologies for deploying ML models at scale, with a specific focus on autoscaling using Ray.io and Kuberay. We will start by introducing Ray.io, a powerful distributed computing framework designed to simplify the scaling of Python-based applications. Attendees will learn how Ray.io can be utilized to enhance the scalability and efficiency of ML model deployments, leveraging its robust scheduling and task execution capabilities. Building on this, we will explore Kuberay, an open-source project that seamlessly integrates Ray.io with Kubernetes, enabling efficient autoscaling of ML workloads. We will discuss the architecture and features of Kuberay, demonstrating how it facilitates the deployment and management of large-scale ML models in production environments. By the end of this presentation, attendees will have a comprehensive understanding of how these technologies can be used to optimize their ML operations and drive innovation in their organizations.
Category of the talk/workshop MLOps, Distributed Systems
Duration (including Q&A) 30mins
Level of Audience Intermediate
Speaker Bio Vishnu Vardhan is a Associate Tech Lead at Kore.ai, actively engaged in the field of Generative AI and LLMs for the past one and a half years. His expertise lies in Machine Learning and NLP, with a growing proficiency in MLOps. Vishnu is committed to crafting AI solutions that are aligned and secure, with a focus on achieving tangible real-world impact.
email: vardhanvishnu691@gmail.com
Prudhvi is a Technical Lead at Kore.ai with a strong expertise in machine learning, natural language processing, and backend engineering. He is dedicated to harnessing technology to address complex challenges and drive innovation. Beyond his professional pursuits, Prudhvi enjoys standup comedy, reading, traveling, and exploring diverse aspects of life, which fuels his creativity and broadens his perspective.
email: poornagurram@gmail.com
Prerequisites(if any) Knowledge of Kubernetes is preferred, but not mandatory