LMDeploy TurboMind reused some components of FasterTransformer in its initial version last year. With the iteration of TurboMind, except for sampling, other parts have been basically rewritten. Currently, there are still some unused files introduced in the first version under the src directory, and deleting them will not have any impact. During the meeting with @lzhangzz on Tuesday, this point was mentioned, and I casually fixed the issue. Hi @lzhangzz @irexyc @lvhan028 May you help review this pr? Thanks.
Modification
as titled
Checklist
Pre-commit or other linting tools are used to fix the potential lint issues.
The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness.
If the modification has a dependency on downstream projects of a newer version, this PR should be tested with all supported versions of downstream projects.
The documentation has been modified accordingly, like docstring or example tutorials.
Motivation
LMDeploy TurboMind reused some components of FasterTransformer in its initial version last year. With the iteration of TurboMind, except for sampling, other parts have been basically rewritten. Currently, there are still some unused files introduced in the first version under the src directory, and deleting them will not have any impact. During the meeting with @lzhangzz on Tuesday, this point was mentioned, and I casually fixed the issue. Hi @lzhangzz @irexyc @lvhan028 May you help review this pr? Thanks.
Modification
as titled
Checklist