pytorch-labs / float8_experimental

This repository contains the experimental PyTorch native float8 training UX
BSD 3-Clause "New" or "Revised" License
194 stars 18 forks source link

enable float types in pytorch for non comptue comms #263

Closed drisspg closed 2 months ago

drisspg commented 2 months ago

Summary

Coupled with this: https://github.com/pytorch/pytorch/pull/126556 test everytihng is pasing

facebook-github-bot commented 2 months ago

@drisspg has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot commented 2 months ago

@drisspg has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot commented 2 months ago

@drisspg merged this pull request in pytorch-labs/float8_experimental@f7a920d2c53db8912f2a0c1d9040dbe71a88906d.