search

jnsougata / aiotube

An Alternative to YouTube Public Data API v3
MIT License
68 stars 12 forks source link

Only the most recent 30 videos are retrieved from _VideoBulk #9

Closed emso-c closed 2 years ago

emso-c commented 2 years ago

To reproduce:

>>> video_ids = Channel("example_id").uploads().ids
>>> print(len(video_ids))

Expected output: The amount of videos the channel has.

Returning output: 30 at max regardless of video amount.

I see that the cause of this behavior is that only the first 30 videos are visible by default until you scroll further down, so the rest can not be obtained with requests module using the following query:

raw = _src(f'{self._url}/videos?view=0&sort=dd&flow=grid')

How are you planning to approach to this problem? I believe it can be done using a headless selenium driver, but it'll add more dependency to your project.

I think this behavior should at least be mentioned in the docs as a side note (sorry if it already is, but I couldn't see such an information).

jnsougata commented 2 years ago

To reproduce:

>>> video_ids = Channel("example_id").uploads().ids
>>> print(len(video_ids))

Expected output: The amount of videos the channel has.

Returning output: 30 at max regardless of video amount.

I see that the cause of this behavior is that only the first 30 videos are visible by default until you scroll further down, so the rest can not be obtained with requests module using the following query:

raw = _src(f'{self._url}/videos?view=0&sort=dd&flow=grid')

How are you planning to approach to this problem? I believe it can be done using a headless selenium driver, but it'll add more dependency to your project.

I think this behavior should at least be mentioned in the docs as a side note (sorry if it already is, but I couldn't see such an information).

Thanks for your concern. Yes you were right. I didn't mention that. I've edited the readme and added a small note on bulk objects. Though that is not sufficient but in some case if you just want total video count I have other way around. Soon I will add a new attribute to the Channel object video_count which will basically return the total number of videos a channel is currently having.