search

BatteredBunny / youtube_scraper

Youtube metadata scraping library for golang
GNU General Public License v3.0
1 stars 0 forks source link

channel scraper #4

Open 0x090909 opened 1 month ago

0x090909 commented 1 month ago

Hello Im trying to use the channel scraper, but the moment I call nextpage the program exists with this error:

error: invalid input

BatteredBunny commented 1 month ago

As this does not use the official api, only the client api it most likely does not work anymore. I last worked on this about 9 months ago so expect this to not work entirely anymore

0x090909 commented 1 month ago

I was trying to make it work again but I think there is something wrong in the json deserializer, I checked the returned rawJson and the data is there, the only thing that has to be corrected is the json path to retrieve the videos array, can you please check?

0x090909 commented 1 month ago

just point me in the correct direction to correct the json path.

BatteredBunny commented 1 month ago

Seems that video amount and subscribers amount on the initial page of data have moved, probably a better way to fix it but a quick one is as such: fix.patch

BatteredBunny commented 1 month ago

PS. Enable the Debug variable in debug.go, it will spit out all json it comes across, also in jetbrains editors if you open the json file you can click on certain parts and copy path, will help with using rjson library. Also please look at examples folder, theres a bunch of tests which will help you find things that have broken

0x090909 commented 1 month ago

thanks