vllm-project / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs
https://docs.vllm.ai
Apache License 2.0
29.15k stars 4.35k forks source link

[RFC]: Branch based version control, and development version #5565

Open simon-mo opened 4 months ago

simon-mo commented 4 months ago

Motivation.

Currently, vLLM manages the release and development version all through the main branch:

It presents some challenges

Proposed Change.

I think this RFC is open for suggestions.

One straw man proposal is as follows, which roughly follows the way in ray-project/ray:

The downside of this approach is the cumbersomeness of cherry-picks. But the upside is the ease of version management.

Feedback Period.

Open until concensus

CC List.

@WoosukKwon @robertgshaw2-neuralmagic @khluu @dgoupil @lanking520

Any Other Things.

No response

github-actions[bot] commented 1 day ago

This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!