Emit statistics - Githubissues

exo-explore / exo

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

GNU General Public License v3.0

14.71k stars 789 forks source link

Open AlexCheema opened 4 months ago

AlexCheema commented 4 months ago

tokens / sec
memory usage
gpu utilisation
bytes sent / received
num errors
MFU (great metric. see e.g. https://x.com/__tinygrad__/status/1814519105346810038)

AlexCheema commented 3 months ago

Should be easy to add this to opaque status, since that can hold arbitrary values and already gets broadcast to all nodes.