WIP: support table multi data base on vllm-0.5.4

ZJUICI / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

https://docs.vllm.ai

Apache License 2.0

0 stars 1 forks source link

Closed zTaoplus closed 2 months ago

zTaoplus commented 2 months ago

TODO:

[ ] Simplify the code by removing redundant sections.
[ ] Modify the architecture and model types to align with TableGPT
[ ] Adding some auto-mapping files, such as modeling_tablegpt.py, and related files for running the model with transformers.
[ ] migrate to the version based on vLLM 0.5.5