search

ndif-team / nnsight

The nnsight package enables interpreting and manipulating the internals of deep learned models.
https://nnsight.net/
MIT License
399 stars 37 forks source link

nnsight support for VLLM with Tensor Parallelism #270

Closed AdamBelfki3 closed 3 weeks ago

AdamBelfki3 commented 3 weeks ago

…xpose vllm model tokenizer