seperate quantize and export_to_edge in builder

pytorch / executorch

On-device AI across mobile, embedded and edge for PyTorch

https://pytorch.org/executorch/

Other

1.39k stars 228 forks source link

seperate quantize and export_to_edge in builder #3613

Closed cccclai closed 1 month ago

cccclai commented 1 month ago

Summary: Currently export_to_edge includes both applying quantizer and run to_edge, separate them so I can call quantize only in the eval_llama.py

Differential Revision: D57367832

pytorch-bot[bot] commented 1 month ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/3613

:page_facing_up: Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

:white_check_mark: No Failures

As of commit 284a9283afe244eaa989d7d79dbed51621d39e76 with merge base 5c70121323fd3580438924c361364f5564e64efe (): :green_heart: Looks good so far! There are no failures yet. :green_heart: