Open JJassonn69 opened 2 weeks ago
Intreasted might help with the audio to vedio thing as might get exp with the pipelines
@lukiod thanks again for being such a dedicated bounty hunter π. Your work is truly appreciated by the community. I assigned you to the issue.
Overview
To enhance the feature set of our ai-network, we aim to implement a
text-to-audio
pipeline using the Stable Audio model by Stability AI. This new pipeline will open up exciting possibilities for media generation within our network, enabling users to convert text inputs into high-quality audio outputs. By adding this functionality π§, we are expanding the capabilities of the Livepeer AI network, allowing for a more comprehensive suite of tools that support creative and practical applications in media creation. π₯We are calling on the community to help implement this crucial pipeline on the AI-worker side of the ai-subnet project. Integrating this pipeline will complement our existing pipelines, creating a more robust infrastructure for complete media generation. This will empower developers, content creators, and other stakeholders to seamlessly generate audio from textual data, thereby enriching the creative potential and utility of the ai-subnet. π
Required Skillset
Bounty Requirements
/text-to-audio
route and pipeline in the AI-worker repository. This pipeline should be accessible on docker port8008
.Duration
,Diffusion Steps
, andCFG Scale
for the audio generation should be tuneable.Scope Exclusions
Implementation Tips
To understand how to create a new pipeline, you can refer to recent pull requests where new pipelines were added:
Pull Request #96 Pull Request #103
Additionally, make sure to:
stable audio
in huggingface spaces, so review those works. This can provide valuable insights and a foundation for your work.runner/gen_openapi.py
file to generate the updated OpenAPI spec.make
command to generate the necessary bindings, ensuring your implementation works seamlessly with the go-livepeer repository.How to Apply
#developer-lounge
channel on our Discord server.Thank you for your interest in contributing to our project! π