livepeer / bounties

Livepeer Software Bounties Portal.
https://livepeer.org
3 stars 1 forks source link

Grafana Dashboard for Orchestrator Metrics Bounty [$500] #50

Open JJassonn69 opened 4 weeks ago

JJassonn69 commented 4 weeks ago

Overview

To bolster observability and performance monitoring within the Livepeer AI network, we want to develop a Grafana Dashboard focused on Orchestrator Metrics. This dashboard will deliver vital insights into the AI-job operations managed by Orchestrators, empowering them with approximate health metrics of their servers. By offering a comparative analysis of their operations against others in the network, orchestrators will gain the tools needed to optimize their nodes and secure more work opportunities. 🚀

We invite the community to contribute to this essential initiative, which will significantly enhance orchestrator operations and visibility. The implementation of this dashboard is key to monitoring and optimizing AI job requests and orchestrator performance, ensuring the AI subnet operates at peak efficiency. 🔥


Required Skillset


Bounty Requirements

Several orchestrator-specific metrics have been added to the ai-video branch through this pull request. Leveraging these metrics, the bounty hunter is expected to:

  1. Implementation: Develop a user-friendly Grafana Dashboard that is easy to set up and tailored for Orchestrators within the network. Following create a pull request to the Livepeer grafana dashboards repository.
  2. Functionality: The dashboard should showcase essential metrics such as number of requests per model and pipeline, price per unit paid per request, request latency score, error rates, estimated inference earnings, total tickets received, winning tickets, and other critical data points.

Scope Exclusions


Scope Exclusions


Implementation Tips

To understand how to work with Orchestrator metrics, you can refer to a recent pull request that is similar and deals with metrics for Gateway operators.

Pull Request #3087

Additionally, make sure to:


How to Apply

  1. Express Your Interest: Comment on this issue to indicate your interest and explain why you're the ideal candidate for the task.
  2. Wait for Review: Our team will review expressions of interest and select the best candidate.
  3. Get Assigned: If selected, we'll assign the GitHub issue to you.
  4. Start Working: Dive into your task! If you need assistance or guidance, comment on the issue or join the discussions in the #developer-lounge channel on our Discord server.
  5. Submit Your Work: Create a pull request in the relevant repository and request a review.
  6. Notify Us: Comment on this GitHub issue when your pull request is ready for review.
  7. Receive Your Bounty: We'll arrange the bounty payment once your pull request is approved.
  8. Gain Recognition: Your valuable contributions will be showcased in our project's changelog.

Thank you for your interest in contributing to our project! 💛

[!WARNING] Please wait for the issue to be assigned to you before starting work. To prevent duplication of effort, submissions for unassigned issues will not be accepted.

abhishek818 commented 4 weeks ago

@rickstaa @JJassonn69 can I take this up? You can checkout some of my golang based open source contributions here.

rickstaa commented 4 weeks ago

@rickstaa @JJassonn69 can I take this up? You can checkout some of my golang based open source contributions here.

Hi @abhishek818,

Thank you for your interest in contributing to our open-source community ❤️‍🔥! Unfortunately, this bounty is actually part two of a previous task, which you can find here: https://github.com/livepeer/bounties/issues/49. It was created to break the larger task into smaller parts, and as such, it has already been assigned to someone working on the initial bounty.

You can check out the implementation progress here: link.

We regularly post new bounties, so I'm confident there will be more opportunities for you to contribute soon. Keep an eye out, and we hope to see you involved in future projects 🚀!

rickstaa commented 2 weeks ago

This bounty was completed by @stronk-dev in https://github.com/livepeer/grafana-dashboards/pull/1.