search

Guangxuan-Xiao / torch-int

This repository contains integer operators on GPUs for PyTorch.
MIT License
183 stars 50 forks source link

what is ellm.tools.quantize_int? #26

Open DongHun1995 opened 8 months ago

DongHun1995 commented 8 months ago

I really enjoy read this repository

i wonder that

/benchmark/bench_model.py In line 3, from ellm.tools.quantize_int import quantize_model_int

what is ellm.tools.quantize_int?