This tool automates restoration of RDS database instances from snapshots into any dev, staging or production environments. It supports individual RDS Snapshot as well as cluster snapshot restore operations.
Adding the above to support GPU functions and load the model in 8bit
Thanks for contributing this Pull Request. Make sure that you submit this Pull Request against the master branch of this repository, add a brief description, and tag the relevant issue(s) and PR(s) below.
Description
Adding https://github.com/TimDettmers/bitsandbytes Adding https://pypi.org/project/accelerate/
Adding the above to support GPU functions and load the model in 8bit
Thanks for contributing this Pull Request. Make sure that you submit this Pull Request against the
master
branch of this repository, add a brief description, and tag the relevant issue(s) and PR(s) below.