Open parrykhai opened 5 years ago
Will mixed-precision be able to accommodate the 10.9gb in 8gb since using fp16 essentially doubles the VRAM.
@parrykhai I haven't tried this. It's worthwhile to give it a try. If it works, you can send a new pull request and I will accept it.
Will mixed-precision be able to accommodate the 10.9gb in 8gb since using fp16 essentially doubles the VRAM.