search

notneet / nime-crawler

This is not a bot for crawling anime web (under dev). See implementation at https://notnime.vercel.app
https://api-crawler.notneet.my.id/docs
1 stars 0 forks source link

Start Develop Video Scraper #5

Open Hanivan opened 9 months ago

Hanivan commented 9 months ago

maybe for object_id, we will use origin url + "-epsNum"?

const crypto=require('crypto');
console.log(crypto.createHash('md5').update("https://otakudesu.cam/anime/kono-suba-bakuen-sub-indo/").digest('hex'));
// 1950c872b4f3ed56d78cd812a5c9fa1c (watch object_id)

console.log(crypto.createHash('md5').update("https://otakudesu.cam/anime/kono-suba-bakuen-sub-indo/-1").digest('hex'));
// f95c192941084b0646a67e78083dd769 (stream object_id)
Hanivan commented 9 months ago

After test implement using react-player at https://github.com/notneet/NotNime. for now, we know Content-Type of video can be preview/played is video/m4a, video/mp4

for the lib convert to video.mp4.... @ffmpeg/ffmpeg?

Hanivan commented 8 months ago

Mungkin untuk menghemat obs storage.. kita bisa menyimpan embed video streamnya. lalu bakal ada tambahan service untuk extract real url stream video nya. e.g

https://rr4---sn-uxa3vhnxa-jb3y.googlevideo.com/videoplayback?expire=1708025097&ei=ifTNZeCPBaLDsfIP0PSL8AI&ip=2a04:3543:1000:2310:30da:13ff:fead:6be6&id=45fb818d3c09c24e&itag=18&source=blogger&xpc=Egho7Zf3LnoBAQ%3D%3D&susc=bl&eaua=jU-_xDA-L8U&mime=video/mp4&vprv=1&dur=1431.486&lmt=1704636882458116&txp=1311224&sparams=expire,ei,ip,id,itag,source,xpc,susc,eaua,mime,vprv,dur,lmt&sig=AJfQdSswRgIhAKGqr2c7RlBGOcnQFE7ylULG_K4LlfgELnDYzgjSZPrKAiEAt6WYRq5gJHWx0tMWYnwd_0cSN6SrDa-4lQq_zeHfytY%3D&redirect_counter=1&rm=sn-npodd7z&req_id=c4c3e0f32702a3ee&cms_redirect=yes&cmsv=e&ipbypass=yes&mh=Zt&mip=114.124.130.42&mm=31&mn=sn-uxa3vhnxa-jb3y&ms=au&mt=1707996077&mv=m&mvi=4&pcm2cms=yes&pl=22&lsparams=ipbypass,mh,mip,mm,mn,ms,mv,mvi,pcm2cms,pl&lsig=APTiJQcwRQIhAI1XgcLrXW8y5arWglI8vX0pqJ4ALgpDfSrPIPfZ-ZKcAiBY7mD1YF1gtsyAjxQZpSFzU9z4qzD8C2zKErqH_2hOPQ%3D%3D

Dan cara ini ga perlu banyak waktu dibanding dengan cara watch some anime, lalu buat job untuk crawl&download video nya satu-satu...

Hanivan commented 5 months ago

i made separated library. Nsharedlib

for now, it will handle gdrive link download. and extract video embed at otakudesu