eaidova
commented
1 month ago @saivivekseeram1 thank that you let us know! I prepared upgrade version in notebooks https://github.com/openvinotoolkit/openvino_notebooks/pull/2085
Closed saivivekseeram1 closed 1 month ago
eaidova
commented
1 month ago @saivivekseeram1 thank that you let us know! I prepared upgrade version in notebooks https://github.com/openvinotoolkit/openvino_notebooks/pull/2085
Context
Worked in phi-3, model id from hugging face: microsoft/Phi-3-mini-128k-instruct. opevino-version: 2024.3.0-15583-df6a25800d3 i'm using transformers: transformers 4.39.3
below is the error:
KeyError: "phi3 is not supported yet for transformers. Only ['audio-spectrogram-transformer', 'albert', 'bart', 'beit', 'bert', 'blenderbot', 'blenderbot-small', 'bloom', 'camembert', 'clip', 'codegen', 'convbert', 'convnext', 'convnextv2', 'cvt', 'data2vec-text', 'data2vec-vision', 'data2vec-audio', 'deberta', 'deberta-v2', 'deit', 'detr', 'distilbert', 'donut', 'donut-swin', 'dpt', 'electra', 'encoder-decoder', 'esm', 'falcon', 'flaubert', 'gemma', 'glpn', 'gpt2', 'gpt-bigcode', 'gptj', 'gpt-neo', 'gpt-neox', 'groupvit', 'hubert', 'ibert', 'imagegpt', 'layoutlm', 'layoutlmv3', 'lilt', 'levit', 'longt5', 'marian', 'markuplm', 'mbart', 'mistral', 'mobilebert', 'mobilevit', 'mobilenet-v1', 'mobilenet-v2', 'mpnet', 'mpt', 'mt5', 'musicgen', 'm2m-100', 'nystromformer', 'owlv2', 'owlvit', 'opt', 'qwen2', 'llama', 'pegasus', 'perceiver', 'phi', 'pix2struct', 'poolformer', 'regnet', 'resnet', 'roberta', 'roformer', 'sam', 'segformer', 'sew', 'sew-d', 'speech-to-text', 'speecht5', 'splinter', 'squeezebert', 'swin', 'swin2sr', 't5', 'table-transformer', 'trocr', 'unispeech', 'unispeech-sat', 'vision-encoder-decoder', 'vit', 'wavlm', 'wav2vec2', 'wav2vec2-conformer', 'whisper', 'xlm', 'xlm-roberta', 'yolos', 'baichuan', 'minicpm', 'stablelm', 'chatglm', 'mixtral', 'qwen', 'starcoder2', 'yi', 'jais', 'stablelm_epoch', 'stablelm-epoch', 'stablelm2', 'aquila', 'codegen2'] are supported for the library transformers. If you want to support phi3 please propose a PR or open up an issue."
but i've seen the transformers>=4.38.1 which is used in openvino_notebooks. for the referfence i've attched the screeshots.
What needs to be done?
provide transformers for phi-3 model
Example Pull Requests
No response
Resources
Contact points
@ngaloppo @ilya-lavrenov @alexsu52 @ljaljushkin @pavel-esir
Ticket
No response