search

pytorch-labs / float8_experimental

This repository contains the experimental PyTorch native float8 training UX
BSD 3-Clause "New" or "Revised" License
211 stars 20 forks source link

[bc-breaking] move tensor scaling configuration to Float8LinearConfig #325

Closed vkuzo closed 3 months ago

vkuzo commented 3 months ago

Stack from ghstack (oldest at bottom):

Summary:

Moves the fields configuring per-tensor scaling options to Float8LinearConfig, to set us up for upcoming new configurations such as other scaling granularities, and simplify configuraiton in general.

Test Plan:

./test/test_everything.sh

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: D60176980

vkuzo commented 3 months ago

@vkuzo has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot commented 3 months ago

This pull request has been merged in pytorch-labs/float8_experimental@f64d339018bcdbe9de540310c5ff9d9c9a7d0a0d.