search

microsoft / torchscale

Foundation Architecture for (M)LLMs
https://aka.ms/GeneralAI
MIT License
3.01k stars 202 forks source link

Fairseq version compatible with torchscale #25

Closed sjelassi closed 1 year ago

sjelassi commented 1 year ago

Hi,

Thank you for your great work to develop Torchscale.

I have been trying to use your codebase but it seems like some modules such as "fairseq.models.squad" that were available during the development of Torchscale are not available anymore in the current version of Fairseq.

Can you let me know the version (or the commit) of fairseq you are using to make Torchscale work?

Thanks for your help, Samy

shumingma commented 1 year ago

This version of fairseq can be found at https://github.com/microsoft/torchscale/tree/main/examples/fairseq#setup

Or directly refer to https://github.com/shumingma/fairseq/tree/moe