aatmanvaidya
commented
6 months ago 1. Identify what is the best technique to do this
All the popular methods use hashing
- https://stackoverflow.com/questions/1072569/see-if-two-files-have-the-same-content-in-python
- https://stackoverflow.com/questions/748675/finding-duplicate-files-and-removing-them
- https://stackoverflow.com/questions/6374717/should-all-implementations-of-sha512-give-the-same-hash
filecmp
Audio similarity
- https://stackoverflow.com/questions/38971969/how-to-compare-audio-on-similarity-in-python
- Librosa - https://github.com/d4r3topk/comparing-audio-files-python/blob/master/mfcc.py
- https://librosa.org/doc/main/generated/librosa.segment.cross_similarity.html#librosa.segment.cross_similarity
- https://dev.to/hiisi13/find-an-audio-within-another-audio-in-10-lines-of-python-1866
Video Simiarity
- https://pypi.org/project/vpdq/0.0.1/
- https://stackoverflow.com/questions/28935851/how-to-compare-a-video-with-a-reference-video-using-opencv-and-python
- https://docs.opencv.org/2.4.10/doc/tutorials/highgui/video-input-psnr-ssim/video-input-psnr-ssim.html?highlight=video
- https://stackoverflow.com/questions/42902100/comparing-two-exact-videos-using-opencv-python
- https://en.wikipedia.org/wiki/Structural_similarity_index_measure
- https://stackoverflow.com/a/33773833/13864403
dennyabrain
For every media item that we receive on the tipline, we need to show to the users how many occurences of this exact file exist on the server. Given our infra, the scope of this task is to