huggingface / optimum-neuron

Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.

Apache License 2.0

195 stars 59 forks source link

Make neuron_cc_optlevel `None` by default #632

Closed michaelbenayoun closed 3 months ago

michaelbenayoun commented 3 months ago

What does this PR do?

As per title. If the user does not specify an optimization level explicitly for the compiler, none is set. Before it was set to 2 by default which can slow the compilation.

HuggingFaceDocBuilderDev commented 3 months ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.