search

THU-BPM / MarkLLM

MarkLLM: An Open-Source Toolkit for LLM Watermarking.（EMNLP 2024 Demo）
https://aclanthology.org/2024.emnlp-demo.7/
Apache License 2.0
284 stars 29 forks source link

Compatible with vLLM #19

Closed dapurv5 closed 2 months ago

dapurv5 commented 2 months ago

Any plans to make it compatible with vLLM for faster generations?

panly2003 commented 2 months ago

Thank you for your suggestions! Our current project does not include a module for LLM inference acceleration, but we can consider adding it in the future.