kyegomez / LIMoE

Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts"
https://discord.gg/47ENfJQjMq
MIT License
18 stars 2 forks source link

[BUG] #5

Open AshleyLuo001 opened 2 months ago

AshleyLuo001 commented 2 months ago

Hello, I hope you're having a great day! I encountered an error while trying to run the code from limoe.main import LiMoE. The error message I received was: 'ImportError: cannot import name 'Attention' from 'zeta.nn'. However, I have already executed the command pip3 install -U zetascale and successfully installed it. Could there be an issue?

Upvote & Fund

Fund with Polar

github-actions[bot] commented 2 months ago

Hello there, thank you for opening an Issue ! 🙏🏻 The team was notified and they will get back to you asap.