ManifoldRG / NEKO

In Progress Implementation of GATO style Generalist Multimodal model capable of image, text, RL and Robotics tasks
https://discord.gg/brsPnzNd8h
GNU General Public License v3.0
38 stars 9 forks source link

Profiling existing models #61

Open harshsikka opened 6 months ago

harshsikka commented 6 months ago

Context:

We want to profile existing multimodal models we picked in #62 and evaluate them on the benchmark we are proposing.

Output:

Reported model performance on benchmark