pytorch-labs / float8_experimental

This repository contains the experimental PyTorch native float8 training UX
BSD 3-Clause "New" or "Revised" License
211 stars 20 forks source link

fixes to matmul and linear benchmarks #320

Closed vkuzo closed 4 months ago

vkuzo commented 4 months ago

Stack from ghstack (oldest at bottom):

Summary:

for matmul benchmarks, unbreaks them - we need the scales to be fp32, not integers

for linear benchmarks, aligns default settings to current best supported path (compile on, dynamic scaling)

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: D59877198

vkuzo commented 4 months ago

@vkuzo has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot commented 4 months ago

This pull request has been merged in pytorch-labs/float8_experimental@ec8b46cda737cb72c0769eba42341edf50111e22.