livepeer / grants

⚠️ DEPRECATED ⚠️ Please visit the new homepage at https://livepeer.notion.site/Livepeer-Grants-Program-f91071b5030d4c31ad4dd08e7c026526
44 stars 7 forks source link

Async Video Podcast Creation With Pinch Media and JournoDAO #124

Closed kaxline closed 1 year ago

kaxline commented 1 year ago

Give a 3 sentence description for your proposal.

Pinch makes it easy to record videos asynchronously so that participants don’t need to be present at the same time. Imagine a regular video podcast with a host and guests, but instead of everyone being present at a scheduled time, they can record their parts separately in sequence. The host records themselves asking a question, and then guests get an alert and can respond whenever is convenient for them.

As an open source protocol and project, we’d love to use Livepeer to host and serve all the video required for the app. As well as a browsable directory of videos made on Pinch.

Describe the problem you are solving.

We are becoming an ever more global society. We increasingly work with people across the globe in different time zones, and out of necessity much of our communication is becoming asynchronous. You send a hand off email to your coworker at the end of your work day and wake up to her hand off email back to you. We are also becoming a society of creators. Anyone can be a TikTok star because the TikTok app is intuitive, fun, and easy to use.

It’s a natural progression, then, to want an easy way to asynchronously create video content with multiple contributors. Pinch removes the hassle of coordinating a group of people to contribute their video to a project. It also solves the pain of editing each individual part together to make a cohesive sequential product at the end. Professionals will still want to edit their own video by hand, but Pinch allows people with no editing experience to easily create compelling content from multiple contributors asynchronously.

Livepeer would be a crucial partner in this endeavor since we have no desire to rely on centralized video platforms, nor any desire to build something similar to Livepeer ourselves.

Describe the solution you are proposing and how it will have a positive impact on the Livepeer developer ecosystem.

Pinch gives users the tools to create media in a new way. Here’s how it works.

A host starts a video in Pinch and then invites guests to contribute. Once everyone has accepted the invite, the host can choose the order in which guests should respond. The host then records the first section of video. For example, they may record an introduction to the show and ask a question of the guests. When they’re finished, they indicate they’re done and the next contributor in the sequence should be prompted.

The next contributor is then alerted that it’s their turn to contribute. Pinch is designed so that days or weeks may pass before the next contributor records their response. When they do, they’re able to see the previous videos that were recorded and then add their own video to the sequence. When they’re done, the next person in the sequence is alerted.

In this way, a distributed panel of guests can contribute coherently to a conversation over space and time via the content container that Pinch provides.

At any time during the process, each participant can view the progress of the conversation and the latest contributions. They can also request to speak next if they feel like they want to jump into the conversation out of turn.

Another exciting opportunity is to have an asynchronous audience as well. The audience could have access to the conversation in progress and contribute their comments, questions, and suggestions. The whole experience is like a live stream happening asynchronously and in slow motion. Each participant can contribute what they want, when they want.

The platform is also general enough to allow for other use cases that we may not yet anticipate. Our goal is to make Pinch the best tool for asynchronous video creation involving many contributors. But the primary use case for now is the one described above.

For any protocol, it’s the apps that drive adoption. We think this could be a unique and fun app to bring users and awareness to the Livepeer ecosystem.

Describe why you are the right team with the capability to build this.

Pinch will be built by three founding members of JournoDAO, a DAO for journalists.

They are:

Keith Axline https://www.linkedin.com/in/keithaxline/ Seasoned full stack developer with over 20 years of experience

John Miller https://www.linkedin.com/in/keithaxline/ Senior video podcast producer, software developer

Crystal Street https://www.linkedin.com/in/crystalstreet/ Senior project manager and marketing strategist

Journalists are often not considered as product developers or innovators, and we’d like to change that. We see this async contribution model as being super helpful to journalists as they explore new narrative tools and news gathering methods. The founding team at JournoDAO also has extensive experience in the video and podcast space, a strong product background, and a wide network of journalists that can help spread adoption.

At JournoDAO, part of our mission is to empower journalists to take control of technology and make it work for them. So when journalists ask JournoDAO what web3 enables, we want to point to Pinch Media as an example of a novel use case and a way to re-imagine media.

A good previous model of this would be the popular javascript Timeline tool:

https://timeline.knightlab.com/

It was developed to scratch the itch of journalists but now many developers and publications use it for timelines for a wide variety of use cases.

Pinch could exist in web2 as an extractive startup that takes investors money and tries to capture as many users as possible in order to monetize them at some later point.

Instead, it’s far more compelling to partner with Livepeer and other web3 services to build Pinch into something that’s open and generative for the community.

JournoDAO is committed to building public goods and will share the code for this project with the public whenever possible. Journalists will be our first users, but nothing about the platform is specific to journalists or journalism.

Describe the scope of the project including a 3 month timeline and milestones.

Completion of this project will yield an MVP version of the app with the following functionality.

Pinch creators will be able to:

Pinch contributors will be able to:

In order to do this, we’ll leverage a popular and well-tested open source project called Ennuicastr:

https://ecastr.com/

We’ll run our own Ennuicastr server that will handle the recording of video and collecting assets from various contributors, plus some automated editing functions. With Ennuicastr and Livepeer handling much of the heavy lifting here, we can focus on the UX and frontend application.

We’ve designed the proposal to be done in three stages to give Livepeer the option to issue a smaller grant and wait to see results before committing to follow-on grants.

The proposed development schedule is as follows:

Phase 1 $15k requested ~ 1 month

The first phase will include the setup of the dev, staging, and production environments. By the end of the phase, the following milestones should be reached:

Dev tasks

Creators

Contributors

Phase 2 $25k requested ~ 2 months

The second phase will include the bulk of the feature and UI development. Here we’ll be focused on the integration of the Ennuicastr server with a frontend UI and get a basic UX for a minimal end-to-end proof of concept.

The following milestones should be reached:

Creators

Contributors

Backend

Phase 3 $10k requested ~ 1 month

This majority of this phase will be spent testing and fixing bugs. We’ll also leave time to wrap up any lingering issues from the previous phase. The major technical addition will be stitching videos into a single file and offering video export options.

The following milestones should be reached:

Dev tasks

Creators

Contributors

Please estimate hours spent on project based on the above and how much funding you will need.

Included above in the discussion of the development phases.

An itemized budget for each phase is available upon request, but generally assumes 20hrs/wk each from Keith Axline and John Miller, with Crystal Street handling a smaller commitment (about 5hrs/wk) in project management to keep the product on track.

Thank you so much for your consideration. We hope we can work together to bring Pinch to life.

hansy commented 1 year ago

Hey @kaxline. Thanks for applying for a grant! This seems like a novel and very interesting use case for video, and we'd love to explore this idea with you a little more!

We've recently revamped our grants program and now offer up to $15K in grant amount to projects. Given this change, perhaps we can work together to update the scope of the project to fit the tighter budget. In particular we'd be most interested in general Livepeer integration within the app as well as how Livepeer + eCastr fit together.

Let me know if you'd still like to pursue the grant. As aforementioned, happy to tweak scope with you to make it work for all parties!

kaxline commented 1 year ago

@hansy Sorry, I didn't get a notification on this somehow so I just now checked back. I think we can pull these pieces apart a bit to focus on the basics closest to Livepeer.

What's the best way to discuss? Should I just attempt a new scope and roadmap here with the new budget?

hansy commented 1 year ago

Hey @kaxline. Thanks for getting back to me! So the most interesting piece of the project from our standpoint is how Livepeer might fit with Ennuicastr server. Our team doesn't actually know too much about Ennuicastr server. Who uses this tool? For what purposes? Aside from JournoDAO, are there any other publications/journalistic entities that are looking for something like Pinch? Does Ennuicastr have a strong developer community?

For scope, perhaps re-framing the project as a minimal, working, open-source integration with Livepeer + eCastr might make the most sense. Other developers can then create their own UI, authentication, etc over this modular piece.

kaxline commented 1 year ago

@hansy We've actually pushed this idea forward a bit since the initial proposal and Enuuicaster may not be the best fit after all. A lot of the value it provides is in handling the real-time nature of video calls, and that's precisely what we're NOT doing.

There are some great solutions contained in its architecture that we can definitely draw from. However, it seems like the best integration with Livepeer + Ennuicaster might be swapping out Ennuicaster's use of Jitsi as a WebRTC node to use Livepeer instead. Or give users the option to use either. That might be worth pursuing with the founder of Ennuicaster as he seems very aligned with the Livepeer ethos ... Or maybe approaching Jitsi itself?

As for Pinch, we've also looked a bit more into how we would use Livepeer specifically and I think we could skip some of the more product-y parts of the roadmap like a landing page, email notifications, user accounts, auth, etc.

Perhaps we could just create a single, open instance of what a Pinch session would look like and do a bare bones UI that performs the necessary coordination and editing functions. We could just do invite codes handed out manually or Unlock Protocol NFTs for gating. That way most of the focus would be on the Livepeer implementation. Based on that single instance, both Livepeer and our team would have a sense of whether there is something worth pursuing here from a product perspective.

I see Livepeer as backing all the necessary video players and streaming, while Pinch handles the UI and audio/video stitching. We're also open to suggestions on how/where to store the video data itself.

If this grant money is purely for technical implementations and innovations, there may not be enough here to excite the community, which is totally understandable. Our thinking was that we could build a super useful and engaging app that uses Livepeer instead of using any centralized services. In that way Pinch would act as a funnel for Livepeer awareness and adoption. The partnership could be made clear and visible wherever it makes sense.

We are definitely aligned with also making Pinch its own protocol, or open source in the same way that Ennuicaster is, we just want to do a little bit more exploration of the idea before we can outline how that all might work.

What do you think?

hansy commented 1 year ago

Livepeer, unfortunately, doesn't easily support WebRTC out of the box (at least not super easily) just yet. If there are real-time requirements for video (I don't think there are for this proposal), it's probably best to use other solutions for now and just have Livepeer handle transcoding.

If this grant money is purely for technical implementations and innovations, there may not be enough here to excite the community...

Yeah the grant amount is only up to $15k; we're trying to be pretty tight and conscious about how we allocate funds. This generally lends itself to fairly scoped applications, typically revolving around integration. But if you're using Livepeer Studio, then integration with Livepeer is actually pretty trivial (a few API calls).

We absolutely want to see more interesting, web3-native applications being built (around video). It feels like something is here. Awareness of each others' orgs is certainly cool (and we're happy to engage in co-marketing with your team), but we also want to see applications with real usage (which web3 sorely lacks). The $15k may not cover the expenses for a full-on app, but if it can fund some core elements that have real promise of delivering fun and useful derivatives, that's what we're all about.

hansy commented 1 year ago

Closing for inactivity