Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
The GenAI packages will provide torchsharp implementation for a series of popular GenAI models. The goal is to load the same weight from the corresponding python regular model.
[x] Add design doc (#7170)
[x] Add Microsoft.ML.GenAI.Core (#7177)
The following models will be added in the first wave
Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like The
GenAI
packages will provide torchsharp implementation for a series of popular GenAI models. The goal is to load the same weight from the corresponding python regular model.Microsoft.ML.GenAI.Core
(#7177)The following models will be added in the first wave
Microsoft.ML.GenAI.Phi
) #7184Microsoft.ML.GenAI.LLaMA
)Microsoft.ML.GenAI.StableDiffusion
)Along with the benchmark
Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.
Additional context Add any other context or screenshots about the feature request here.