Remove duplicate videos from the feed (Upload from different users)

go-bazzinga / off-chain-agent

0 stars 2 forks source link

Remove duplicate videos from the feed (Upload from different users) #55

Open harshitasrivastav28 opened 2 weeks ago

harshitasrivastav28 commented 2 weeks ago

FFMpeg which can help us to remove duplicate
They can get the video fingerprint, basis that they can remove the video
Meanwhile look at how can this be done without DS
Combination of both approaches can also work. (DS+backend)
Research on what Youtube does - @veer-asbytes

veer-asbytes commented 2 weeks ago

https://github.com/veer-asbytes/fingerprint expanding further for video files, currently works well for text files it produces similarity score on comparing two files based on their file fingerprinting

veer-asbytes commented 2 weeks ago

this is how yt algo works : https://www.youtube.com/watch?v=9g2U12SsRns&t=1s they does not share their exact algorithm for this

Natasha-GB commented 2 weeks ago

Create a flow diagram to understand/explain the concept @veer-asbytes

veer-asbytes commented 2 weeks ago

simple explanation: vid-fingerprint

veer-asbytes commented 2 weeks ago

as per terms of code video-fingerprint-1

harshitasrivastav28 commented 1 week ago

For exact video duplicate to be stopped using the above proposed solution
Later DS can get involved to take it further.

Natasha-GB commented 1 week ago

Check with portrait videos
Decode using GPU to make the process faster and concurrent
Reduce frame extraction frequency, try tweaking the current number
Use phash instead of sh256 to compare the images/videos @veer-asbytes

Natasha-GB commented 1 week ago

Check industry standards and share findings
Documents insights so far on the issue for easy reference @veer-asbytes
Decode using GPU (to be checked)

harshitasrivastav28 commented 6 days ago

The suggested library doesn't have much customisations available.
@veer-asbytes to look into it further through right libraries
@rupansh-gob to do a quick search and guide on library.
Most of the libraries are not using GPU support.
Rum the logic on sample 1000 videos and see what the results are (Focus on rust)
If there is a match, implementation to be done by @psykomal
When video comes, take out the hash and compare hash directly. Use existing DB for fast lookups.
Check what is the implementation of index internally on redis and use the same and deploy it to canister @komal-rs

harshitasrivastav28 commented 5 days ago

Implemented GPU acceleration but not working as fast as expected
Trying to implement it for hashing
Currently using video tools for GPU acceleration

harshitasrivastav28 commented 4 days ago

@veer-asbytes to write a rust library to help Komal detect the duplicate videos
Off chain agent will pass the video and model will breakdown the frames and generate hash
Offchain > Clousflare > Generate hash > give it to offchain

harshitasrivastav28 commented 3 days ago

published it in seprate crate and anyone can access it