search

mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
18.82k stars 1.53k forks source link

adaptive_softmax, SinusoidalPositionalEmbedding ops are not supported #2173

Open Ramees025 opened 5 months ago

Ramees025 commented 5 months ago

When I tried to add the model support for fairseq model following ops are not present,

AdaptiveSoftmax, BaseLayer, FairseqDropout, LayerDropModuleList, LayerNorm, PositionalEmbedding, SinusoidalPositionalEmbedding,

model: https://huggingface.co/spaces/OFA-Sys/OFA-vqa/tree/main/fairseq/fairseq/models/transformer

Is it possible add support for those ops?

I am following below tutorial for adding new models suppport.

(https://llm.mlc.ai/docs/compilation/define_new_models.html)

MikeLP commented 5 months ago

It would be nice to update define new models section as well.