drawrowfly / tiktok-scraper

TikTok Scraper. Download video posts, collect user/trend/hashtag/music feed metadata, sign URL and etc.
4.44k stars 805 forks source link

Hashtag command with --since option doesn't work well #750

Open MastroPhysics opened 2 years ago

MastroPhysics commented 2 years ago

Describe the bug I am trying to download all hashtagged videos #cat that have been posted since one month ago

Using this on cmd in win 10 with npm

This is my code: tiktok-scraper hashtag cat -d --since 1646969162 -n 100 --session sid_tt=(I found my proper session I don't want to share it)

This only downloads 1 video. I know there are more videos than that.

If fields below will be empty then issue will be Ignored and Closed

To Reproduce Steps to reproduce the behavior:

Screenshots If applicable, add screenshots to help explain your problem.

drawrowfly commented 2 years ago

Will be checked shortly

AminMekacher commented 2 years ago

Hey! I'm encountering the same issue while running the CLI commands on an Ubuntu server. I've noticed that changing the value for the --since parameter or the -n parameter doesn't change the fact that I am only getting the same two results, so I was wondering if this is a good option to try to paginate the results, as @MastroPhysics wanted to do as well.

Here is the code I am running: tiktok-scraper hashtag keto -n 900 -t json --since 1644744654 --session sid_tt=MY_OWN_SID.

srinitude commented 2 years ago

Encountering the same issue!

mandys commented 2 years ago

Facing the same issue. ./node_modules/tiktok-scraper/bin/cli.js hashtag mytag -n 100 --since 1661451076 --session sid_tt=123 --filename results --filetype csv

I get back results in the below order createTime 1661451076 1661243660 1661517950 1661447970 1661436335 1661450791 1661432329 1661516884

My results ordered by createdTime are

createTime

1661243660 1661432329 1661436335 1661447970 1661450791 1661451076 1661516884 1661517950

Now, on the results page - https://www.tiktok.com/tag/mytag

Display order is different. 1661451076 always appears as the first result.

So, then no matter what since date I give, only this result ( 1661451076 ) is returned.

Is this library expecting a particular order in which results would be displayed on the search page ? That could be causing the issue.

Thoughts?