lbryio / lbry-desktop

A browser and wallet for LBRY, the decentralized, user-controlled content marketplace.
https://lbry.tech
MIT License
3.56k stars 413 forks source link

Video multiplexing: Requirement of a functionality. By user CPUhead#8608 #5104

Open es-socrates opened 3 years ago

es-socrates commented 3 years ago

This suggestion was made by user CPUhead#8608 on Discord.

I want to make a suggestion of a function for LBRY or Odysee. Could it accept multiplexed video? Example: A movie with MKV file format that has subtitles, or that you can change the audio from Spanish to English, that is, change multiple audios and subtitles. Am I clear? If not possible, why?

If the video already has those audios and the subtitles are in the MKV format, it is not necessary to upload them to LBRY later, it will be like the DVDs that you could change the language, could it be done, or is it very difficult? Because there are P2P torrent streaming applications that already do it, like stremio.

Not even on the roadmap to implement that feature? It would be very good, because almost all the work of packaging your video, audios and subtitles in another language would have to be done during the production of your content and not afterwards. What do you think?

Is it feasible for the LBRY development team?

If it is very feasible, as I said, there are applications that already do it, such as the stremio that uses torrents and P2P technology, where you can change the subtitles and audio of the video.

Yes, it would be useful because the viewer could see the subtitles in case the video is not in their language or the audio, and also for the creator because it could reach more people by adding subtitles and audios for example.

Case 1, subtitles: Juan is looking for information on how to buy on the Internet, but no results appear in his language, but he has the possibility of watching a video with subtitles thanks to the fact that this video is multiplexed, and the platform allows him allows to switch from subtitles to this.

Case 2, audio: Carlos is watching a movie in LBRY but he doesn't understand the language at all, so thanks to the multiplexed video he can change the audio and enjoy very good moments.

Case 3, the creator: Roberto is a content creator who wants to reach more audiences, so he uses the multiplexer tools while creating his video to add audio in another language in order to reach a larger audience.

CPUhead commented 3 years ago

I hope there are many answers, suggestion and corrections

CPUhead commented 3 years ago

Hi I want to make a suggestion of a function for LBRY or Odysee, could it accept multiplexed video ?, example: a movie with MKV file format that has subtitles, or that you can change the audio from Spanish to English, that is, change Multiple audios and subtitles ? Am I clear? And if it is not possible, why?

I mean if the video already has those audios and subtitles are in the MKV format, it is not necessary to upload them to LBRY later, it will be like the DVDs that you could change the language, could it be done, or is it very difficult? Why are there p2p torrent streaming applications that already do it as stremio

Not even on the roadmap to implement that feature? It would be very good, why almost all the work of packaging your video, audios and subtitles in another language would have to be done during the production of your content and not afterwards, what do you think?

Is it feasible for the LBRY development team?

Yes it is very feasible, as I said, there are applications that already do it, such as stremio that uses torrents and P2P technology, where you can change the subtitles and the audio of the Video.

Could you explain why this function would be useful, tell examples and cases?

If it would be useful because the viewer could see the subtitles in case the video is not in their language or the audio, and also for the creator because it could reach more people by adding Subtitles and audios such as ...

Case 1 Subtitles: Juan is looking for information on how to buy on the internet, but no results appear in his language, but he has the possibility of watching a video with subtitles thanks to the fact that this video is multiplexed, and the platform allows him to change from subtitles to East

Case 2 Audio: Carlos is watching a movie in LBRY but he does not understand the Language at all, so Thanks to the video is multiplexed, he can change the audio and enjoy very good moments

Case 3 The creator: Roberto is a content creator who wants to reach more audiences, so he uses the multiplexer tools while creating his video to add audio in another language in order to reach a larger audience.

DispatchCommit commented 3 years ago

Hmm this would be interesting. Could use ffprobe to probe ingested video files and check for subtitle tracks in the input file, then if subtitles are found, extract them to their respective language's .vtt file.

Probing for subtitles:

ffprobe -loglevel error -select_streams s -show_entries stream=index:stream_tags=language -of csv=p=0 INPUTFILE.mkv

Extracting to a .vtt file:

ffmpeg -nostdin -hide_banner -loglevel quiet -i INPUTFILE.mkv -map 0:TRACKID INPUTFILE_LANG_TRACKID.vtt

References:

Possibly something to copy paste a solution from:

Though I have no familiarity with the ingestion process for LBRY, but doesn't look too bad to do with fluent-ffmpeg.

This should be enough info to get started in the right direction at least.

n1ckl4s commented 3 years ago

Hi I want to make a suggestion of a function for LBRY or Odysee, could it accept multiplexed video ?, example: a movie with MKV file format that has subtitles, or that you can change the audio from Spanish to English, that is, change Multiple audios and subtitles ? Am I clear? And if it is not possible, why?

I mean if the video already has those audios and subtitles are in the MKV format, it is not necessary to upload them to LBRY later, it will be like the DVDs that you could change the language, could it be done, or is it very difficult? Why are there p2p torrent streaming applications that already do it as stremio

Not even on the roadmap to implement that feature? It would be very good, why almost all the work of packaging your video, audios and subtitles in another language would have to be done during the production of your content and not afterwards, what do you think?

Is it feasible for the LBRY development team?

Yes it is very feasible, as I said, there are applications that already do it, such as stremio that uses torrents and P2P technology, where you can change the subtitles and the audio of the Video.

Could you explain why this function would be useful, tell examples and cases?

If it would be useful because the viewer could see the subtitles in case the video is not in their language or the audio, and also for the creator because it could reach more people by adding Subtitles and audios such as ...

Case 1 Subtitles: Juan is looking for information on how to buy on the internet, but no results appear in his language, but he has the possibility of watching a video with subtitles thanks to the fact that this video is multiplexed, and the platform allows him to change from subtitles to East

Case 2 Audio: Carlos is watching a movie in LBRY but he does not understand the Language at all, so Thanks to the video is multiplexed, he can change the audio and enjoy very good moments

Case 3 The creator: Roberto is a content creator who wants to reach more audiences, so he uses the multiplexer tools while creating his video to add audio in another language in order to reach a larger audience.

Excellent proposal, I hope the team takes it into consideration, it would make the job easier.