Open manikawnth opened 1 month ago
We opened a PR to fix this. https://huggingface.co/microsoft/Phi-3-mini-128k-instruct/discussions/68
@philschmid Thanks for that PR. It's working fine, when I pointed it to that revision.
However, shouldn't the issue be actually fixed upstream, by initializing config.attention_bias = False
?
OR
I'm not able to deploy the Phi3 model from huggingface model hub to sagemaker. I tried using multiple DLC containers, with and without
trust_remote_code: true
. Still not able to get it run.I receive the following error: