livepeer / bounties

Livepeer Software Bounties Portal.
https://livepeer.org
3 stars 1 forks source link

Frame Interpolation Implementation in go-livepeer Bounty [$850] #51

Open JJassonn69 opened 2 weeks ago

JJassonn69 commented 2 weeks ago

Overview

We are excited to announce an initiative to activate the frame-interpolation feature across the entire Livepeer network. This enhancement will significantly improve the video generation workflow by producing smoother, more natural-looking videos from outputs of image-to-video models, as well as other video content within the network. By integrating this functionality, we are expanding the capabilities of the Livepeer AI network, offering a more comprehensive suite of tools to support creative and practical applications in media creation. 🔥

We invite the community to contribute to the implementation of this feature 🔧 in the go-livepeer side of codebase. Successfully integrating frame interpolation will complement our existing pipelines, providing a more complete set of tools for media generation. This enhancement will empower developers, content creators, and other stakeholders to seamlessly generate videos with the desired framerate, thereby enriching the experience and utility of the AI network. 🚀


Required Skillset


Bounty Requirements

  1. Implementation: Develop the necessary code within the go-livepeer repository to integrate access to the frame-interpolation pipeline from the ai-worker repository. This includes implementing the payment logic and job routing to ensure seamless operation within the network.
  2. Functionality: Ensure that users can submit AI job requests to the network in a manner consistent with other AI-subnet features.

    Example request: curl -X POST "https://your-gateway-url/frame-interpolation" -F model_id="film_net_fp16.pt" -F video=@directory-path-to-video.mp4 -F inter_frames=3


Scope Exclusions

Implementation Tips

  1. Utilize Earlier Work: Review the existing pipelines already operational within the go-livepeer repository, as the implementation process for this feature will be similar. This can provide a solid reference for your development efforts.
  2. Utilize Developer Documentation: Utilize our developer documentation for the installation of go-livepeer and refer to the general Livepeer documentation for example usage and setup instructions. These resources offer valuable insights that can expedite your development process, including automatic scripts for orchestrators and gateways, and direct debugging techniques.
  3. Build Binaries: Run the make command in the main repository folder to generate Livepeer binaries. This will allow you to test your implementation and ensure it integrates smoothly.
  4. Create Docker Images: Build Docker images of Livepeer and test them using appropriate tools and settings to identify any edge cases or bugs. This step is crucial for ensuring robustness and reliability in your implementation.

How to Apply

  1. Express Your Interest: Comment on this issue to indicate your interest and explain why you're the ideal candidate for the task.
  2. Wait for Review: Our team will review expressions of interest and select the best candidate.
  3. Get Assigned: If selected, we'll assign the GitHub issue to you.
  4. Start Working: Dive into your task! If you need assistance or guidance, comment on the issue or join the discussions in the #developer-lounge channel on our Discord server.
  5. Submit Your Work: Create a pull request in the relevant repository and request a review.
  6. Notify Us: Comment on this GitHub issue when your pull request is ready for review.
  7. Receive Your Bounty: We'll arrange the bounty payment once your pull request is approved.
  8. Gain Recognition: Your valuable contributions will be showcased in our project's changelog.

Thank you for your interest in contributing to our project! 💛

[!WARNING] Please wait for the issue to be assigned to you before starting work. To prevent duplication of effort, submissions for unassigned issues will not be accepted.

abhishek818 commented 2 weeks ago

@rickstaa @JJassonn69 can i pick this ? coming back from this

UkuLoskit commented 2 weeks ago

@JJassonn69

Express Your Interest: Comment on this issue to indicate your interest and explain why you're the ideal candidate for the task.

I would be interested in working on this. I think I am a good candidate because I have a pretty solid track-record of open source contributions and solving bounties (Omnigres, dragonflydb, SerenityOS ). Additionally I have many years of running Golang in production as a backend dev.

rickstaa commented 2 weeks ago

@abhishek818, @UkuLoskit, thank you both for your interest in contributing to our open-source ecosystem 🚀! Unfortunately, @JJassonn69, who expressed interest in developing this feature on Discord some weeks ago, has already completed this bounty in https://github.com/livepeer/go-livepeer/pull/3135. This should have been posted as a retroactive bounty. It seems we overlooked assigning him to the task. Apologies for the inconvenience.

However, we have several other bounties lined up that you can explore. Additionally, we’d love to hear your ideas! If there’s a particular pipeline you’d like to see on the Livepeer network, feel free to suggest it on the discussion board. @JJassonn69 can then ensure it gets posted and assigned to you.