EltonChou
commented
3 months ago I can download those in my environment. Is there any error message or notification ?
Closed lentilwallop closed 3 months ago
EltonChou
commented
3 months ago I can download those in my environment. Is there any error message or notification ?
lentilwallop
commented
3 months ago started google-chrome from command line, no output, where should i be looking for error messages?
nothing unusual seems to occur, other than the file is not downloaded.
the file is listed as being downloaded from the Media Harvest history, but does not exist in the assigned download directory.
EltonChou
commented
3 months ago Is there any download item in chrome://downloads/ ?
Does this behavior occur on other tweets, or does it only happen in this tweet?
Download history doesn't care about the download result. It will record it before the download was triggered.
Starshadow
commented
3 months ago I'm also experiencing this issue. I have discovered that it only occurs when I'm logged in to twitter. I've tested on a fresh chrome profile with only this extension installed. When I'm logged in, some videos and gifs will fail to download. After logging out, the same videos will download fine. It appears to be consistent which tweets are affected. The examples provided above also do not download for me while logged in.
EltonChou
commented
3 months ago Where is your ip geolocation? I think they might push some updates on the api endpoint which was used by this extension.
Starshadow
commented
3 months ago I am in the United States.
EltonChou
commented
3 months ago Can't reproduce the issue. If you know how to use chrome's DevTools, please use devtool in options page then switch to network tab and open console. Try some downloads and check what happens in network and console.
RickyM017
commented
3 months ago Third-party cookie will be blocked. Learn more in the Issues tab.
RickyM017
commented
3 months ago @EltonChou What chrome version are you using?
EltonChou
commented
3 months ago My chrome is 127.0.6533.120
Not in twitter page.
In extension's options page (something like chrome://hpcgabhdlnapolkkjpejieegfpehfdok/index.html)
RickyM017
commented
3 months ago This?
EltonChou
commented
3 months ago Yes. Is this download successful?
jarz76
commented
3 months ago I have the same problem and just noticed it now. If i look on the console tab, the process stuck on "Fetching media info"
EltonChou
commented
3 months ago Can you provide failed twitter api response in text?
jarz76
commented
3 months ago Can you provide failed twitter api response in text?
Like this?
Edit:Also, I tried downloading from the all 3 URL provided above, and it worked for me. However, I still have the same exact problem with some other tweets, especially those containing videos
This one is from x page
{
"data": {
"threaded_conversation_with_injections_v2": {
"instructions": [
{
"type": "TimelineAddEntries",
"entries": [
{
"entryId": "tweet-1825787924748890186",
"sortIndex": "7397584112105885621",
"content": {
"entryType": "TimelineTimelineItem",
"__typename": "TimelineTimelineItem",
"itemContent": {
"itemType": "TimelineTweet",
"__typename": "TimelineTweet",
"tweet_results": {
"result": {
"__typename": "Tweet",
"rest_id": "1825787924748890186",
"has_birdwatch_notes": false,
"core": {
"user_results": {
"result": {
"__typename": "User",
"id": "VXNlcjoxNTg1NzgyMTAzODM2MjE3MzQ0",
"rest_id": "1585782103836217344",
"affiliates_highlighted_label": {},
"has_graduated_access": true,
"is_blue_verified": false,
"profile_image_shape": "Circle",
"legacy": {
"following": false,
"can_dm": false,
"can_media_tag": true,
"created_at": "Thu Oct 27 23:55:15 +0000 2022",
"default_profile": true,
"default_profile_image": false,
"description": "내가 보려고 만든 지미닝 저장소\uD83C\uDF3C",
"entities": {
"description": {
"urls": []
}
},
"fast_followers_count": 0,
"favourites_count": 532,
"followers_count": 37,
"friends_count": 37,
"has_custom_timelines": false,
"is_translator": false,
"listed_count": 0,
"location": "짜릿한My name is /ᐠ ̳◝ ·̫ ◜ ̳マ Ⳋ",
"media_count": 68,
"name": "먼들레",
"normal_followers_count": 37,
"pinned_tweet_ids_str": [
"1796396965493944770"
],
"possibly_sensitive": false,
"profile_banner_url": "https://pbs.twimg.com/profile_banners/1585782103836217344/1704903109",
"profile_image_url_https": "https://pbs.twimg.com/profile_images/1822259534234021888/06RnLU6C_normal.jpg",
"profile_interstitial_type": "",
"screen_name": "MonDandelion510",
"statuses_count": 858,
"translator_type": "none",
"verified": false,
"want_retweets": false,
"withheld_in_countries": []
},
"tipjar_settings": {}
}
}
},
"unmention_data": {},
"edit_control": {
"edit_tweet_ids": [
"1825787924748890186"
],
"editable_until_msecs": "1724140337000",
"is_edit_eligible": true,
"edits_remaining": "5"
},
"is_translatable": true,
"views": {
"count": "610",
"state": "EnabledWithCount"
},
"source": "<a href=\"http://twitter.com/download/iphone\" rel=\"nofollow\">Twitter for iPhone</a>",
"legacy": {
"bookmark_count": 7,
"bookmarked": true,
"created_at": "Tue Aug 20 06:52:17 +0000 2024",
"conversation_id_str": "1825787924748890186",
"display_text_range": [
0,
49
],
"entities": {
"hashtags": [
{
"indices": [
31,
35
],
"text": "위클리"
},
{
"indices": [
36,
44
],
"text": "Weeekly"
},
{
"indices": [
45,
49
],
"text": "먼데이"
}
],
"media": [
{
"display_url": "pic.x.com/ll8ktrwrz8",
"expanded_url": "https://twitter.com/MonDandelion510/status/1825787924748890186/video/1",
"id_str": "1825787678652235776",
"indices": [
50,
73
],
"media_key": "7_1825787678652235776",
"media_url_https": "https://pbs.twimg.com/ext_tw_video_thumb/1825787678652235776/pu/img/aLnUYJmXxxy7uplR.jpg",
"type": "video",
"url": "https://t.co/lL8KtRwrZ8",
"additional_media_info": {
"monetizable": false
},
"ext_media_availability": {
"status": "Available"
},
"sizes": {
"large": {
"h": 720,
"w": 720,
"resize": "fit"
},
"medium": {
"h": 720,
"w": 720,
"resize": "fit"
},
"small": {
"h": 680,
"w": 680,
"resize": "fit"
},
"thumb": {
"h": 150,
"w": 150,
"resize": "crop"
}
},
"original_info": {
"height": 720,
"width": 720,
"focus_rects": []
},
"video_info": {
"aspect_ratio": [
1,
1
],
"duration_millis": 38716,
"variants": [
{
"content_type": "application/x-mpegURL",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/pl/DygjcJaImaK12ATw.m3u8?tag=12"
},
{
"bitrate": 432000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/320x320/gK1oUdeu85NFu_c3.mp4?tag=12"
},
{
"bitrate": 832000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/540x540/83GYEJ9Y65WgF2YQ.mp4?tag=12"
},
{
"bitrate": 1280000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/720x720/uMqrkkyPZUUN96mn.mp4?tag=12"
}
]
},
"media_results": {
"result": {
"media_key": "7_1825787678652235776"
}
}
}
],
"symbols": [],
"timestamps": [],
"urls": [],
"user_mentions": []
},
"extended_entities": {
"media": [
{
"display_url": "pic.x.com/ll8ktrwrz8",
"expanded_url": "https://twitter.com/MonDandelion510/status/1825787924748890186/video/1",
"id_str": "1825787678652235776",
"indices": [
50,
73
],
"media_key": "7_1825787678652235776",
"media_url_https": "https://pbs.twimg.com/ext_tw_video_thumb/1825787678652235776/pu/img/aLnUYJmXxxy7uplR.jpg",
"type": "video",
"url": "https://t.co/lL8KtRwrZ8",
"additional_media_info": {
"monetizable": false
},
"ext_media_availability": {
"status": "Available"
},
"sizes": {
"large": {
"h": 720,
"w": 720,
"resize": "fit"
},
"medium": {
"h": 720,
"w": 720,
"resize": "fit"
},
"small": {
"h": 680,
"w": 680,
"resize": "fit"
},
"thumb": {
"h": 150,
"w": 150,
"resize": "crop"
}
},
"original_info": {
"height": 720,
"width": 720,
"focus_rects": []
},
"video_info": {
"aspect_ratio": [
1,
1
],
"duration_millis": 38716,
"variants": [
{
"content_type": "application/x-mpegURL",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/pl/DygjcJaImaK12ATw.m3u8?tag=12"
},
{
"bitrate": 432000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/320x320/gK1oUdeu85NFu_c3.mp4?tag=12"
},
{
"bitrate": 832000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/540x540/83GYEJ9Y65WgF2YQ.mp4?tag=12"
},
{
"bitrate": 1280000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/720x720/uMqrkkyPZUUN96mn.mp4?tag=12"
}
]
},
"media_results": {
"result": {
"media_key": "7_1825787678652235776"
}
}
}
]
},
"favorite_count": 32,
"favorited": false,
"full_text": "먼데 이 아궁빵\uD83D\uDC68\uD83C\uDFFB\uD83C\uDFF0\uD83C\uDF5E\n\n240817 미레 스페셜 카페\n#위클리 #Weeekly #먼데이 https://t.co/lL8KtRwrZ8",
"is_quote_status": false,
"lang": "ko",
"possibly_sensitive": false,
"possibly_sensitive_editable": true,
"quote_count": 0,
"reply_count": 0,
"retweet_count": 17,
"retweeted": false,
"user_id_str": "1585782103836217344",
"id_str": "1825787924748890186"
},
"quick_promote_eligibility": {
"eligibility": "IneligibleNotProfessional"
}
}
},
"tweetDisplayType": "Tweet",
"hasModeratedReplies": false
}
}
}
]
},
{
"type": "TimelineTerminateTimeline",
"direction": "Top"
}
]
}
}
}This one is from the extension page. There are some slight differences if I use text compare, but I'm not sure about them
{
"data": {
"threaded_conversation_with_injections_v2": {
"instructions": [
{
"type": "TimelineAddEntries",
"entries": [
{
"entryId": "tweet-1825787924748890186",
"sortIndex": "7397584112105885621",
"content": {
"entryType": "TimelineTimelineItem",
"__typename": "TimelineTimelineItem",
"itemContent": {
"itemType": "TimelineTweet",
"__typename": "TimelineTweet",
"tweet_results": {
"result": {
"__typename": "Tweet",
"rest_id": "1825787924748890186",
"core": {
"user_results": {
"result": {
"__typename": "User",
"id": "VXNlcjoxNTg1NzgyMTAzODM2MjE3MzQ0",
"rest_id": "1585782103836217344",
"affiliates_highlighted_label": {},
"has_graduated_access": true,
"is_blue_verified": false,
"profile_image_shape": "Circle",
"legacy": {
"blocked_by": false,
"blocking": false,
"follow_request_sent": false,
"followed_by": false,
"following": false,
"muting": false,
"notifications": false,
"protected": false,
"can_dm": false,
"can_media_tag": true,
"created_at": "Thu Oct 27 23:55:15 +0000 2022",
"default_profile": true,
"default_profile_image": false,
"description": "내가 보려고 만든 지미닝 저장소\uD83C\uDF3C",
"entities": {
"description": {
"urls": []
}
},
"fast_followers_count": 0,
"favourites_count": 532,
"followers_count": 37,
"friends_count": 37,
"has_custom_timelines": false,
"is_translator": false,
"listed_count": 0,
"location": "짜릿한My name is /ᐠ ̳◝ ·̫ ◜ ̳マ Ⳋ",
"media_count": 68,
"name": "먼들레",
"normal_followers_count": 37,
"pinned_tweet_ids_str": [
"1796396965493944770"
],
"possibly_sensitive": false,
"profile_banner_url": "https://pbs.twimg.com/profile_banners/1585782103836217344/1704903109",
"profile_image_url_https": "https://pbs.twimg.com/profile_images/1822259534234021888/06RnLU6C_normal.jpg",
"profile_interstitial_type": "",
"screen_name": "MonDandelion510",
"statuses_count": 858,
"translator_type": "none",
"verified": false,
"want_retweets": false,
"withheld_in_countries": []
},
"super_follow_eligible": false,
"super_followed_by": false,
"super_following": false
}
}
},
"unmention_info": {},
"source": "<a href=\"http://twitter.com/download/iphone\" rel=\"nofollow\">Twitter for iPhone</a>",
"legacy": {
"bookmark_count": 7,
"bookmarked": true,
"created_at": "Tue Aug 20 06:52:17 +0000 2024",
"conversation_id_str": "1825787924748890186",
"display_text_range": [
0,
49
],
"entities": {
"hashtags": [
{
"indices": [
31,
35
],
"text": "위클리"
},
{
"indices": [
36,
44
],
"text": "Weeekly"
},
{
"indices": [
45,
49
],
"text": "먼데이"
}
],
"media": [
{
"display_url": "pic.x.com/ll8ktrwrz8",
"expanded_url": "https://twitter.com/MonDandelion510/status/1825787924748890186/video/1",
"id_str": "1825787678652235776",
"indices": [
50,
73
],
"media_key": "7_1825787678652235776",
"media_url_https": "https://pbs.twimg.com/ext_tw_video_thumb/1825787678652235776/pu/img/aLnUYJmXxxy7uplR.jpg",
"type": "video",
"url": "https://t.co/lL8KtRwrZ8",
"additional_media_info": {
"monetizable": false
},
"ext_media_availability": {
"status": "Available"
},
"sizes": {
"large": {
"h": 720,
"w": 720,
"resize": "fit"
},
"medium": {
"h": 720,
"w": 720,
"resize": "fit"
},
"small": {
"h": 680,
"w": 680,
"resize": "fit"
},
"thumb": {
"h": 150,
"w": 150,
"resize": "crop"
}
},
"original_info": {
"height": 720,
"width": 720,
"focus_rects": []
},
"video_info": {
"aspect_ratio": [
1,
1
],
"duration_millis": 38716,
"variants": [
{
"content_type": "application/x-mpegURL",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/pl/DygjcJaImaK12ATw.m3u8?tag=12"
},
{
"bitrate": 432000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/320x320/gK1oUdeu85NFu_c3.mp4?tag=12"
},
{
"bitrate": 832000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/540x540/83GYEJ9Y65WgF2YQ.mp4?tag=12"
},
{
"bitrate": 1280000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/720x720/uMqrkkyPZUUN96mn.mp4?tag=12"
}
]
},
"media_results": {
"result": {
"media_key": "7_1825787678652235776"
}
}
}
],
"symbols": [],
"urls": [],
"user_mentions": []
},
"extended_entities": {
"media": [
{
"display_url": "pic.x.com/ll8ktrwrz8",
"expanded_url": "https://twitter.com/MonDandelion510/status/1825787924748890186/video/1",
"id_str": "1825787678652235776",
"indices": [
50,
73
],
"media_key": "7_1825787678652235776",
"media_url_https": "https://pbs.twimg.com/ext_tw_video_thumb/1825787678652235776/pu/img/aLnUYJmXxxy7uplR.jpg",
"type": "video",
"url": "https://t.co/lL8KtRwrZ8",
"additional_media_info": {
"monetizable": false
},
"ext_media_availability": {
"status": "Available"
},
"sizes": {
"large": {
"h": 720,
"w": 720,
"resize": "fit"
},
"medium": {
"h": 720,
"w": 720,
"resize": "fit"
},
"small": {
"h": 680,
"w": 680,
"resize": "fit"
},
"thumb": {
"h": 150,
"w": 150,
"resize": "crop"
}
},
"original_info": {
"height": 720,
"width": 720,
"focus_rects": []
},
"video_info": {
"aspect_ratio": [
1,
1
],
"duration_millis": 38716,
"variants": [
{
"content_type": "application/x-mpegURL",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/pl/DygjcJaImaK12ATw.m3u8?tag=12"
},
{
"bitrate": 432000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/320x320/gK1oUdeu85NFu_c3.mp4?tag=12"
},
{
"bitrate": 832000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/540x540/83GYEJ9Y65WgF2YQ.mp4?tag=12"
},
{
"bitrate": 1280000,
"content_type": "video/mp4",
"url": "https://video-cf.twimg.com/ext_tw_video/1825787678652235776/pu/vid/avc1/720x720/uMqrkkyPZUUN96mn.mp4?tag=12"
}
]
},
"media_results": {
"result": {
"media_key": "7_1825787678652235776"
}
}
}
]
},
"favorite_count": 33,
"favorited": false,
"full_text": "먼데 이 아궁빵\uD83D\uDC68\uD83C\uDFFB\uD83C\uDFF0\uD83C\uDF5E\n\n240817 미레 스페셜 카페\n#위클리 #Weeekly #먼데이 https://t.co/lL8KtRwrZ8",
"is_quote_status": false,
"lang": "ko",
"possibly_sensitive": false,
"possibly_sensitive_editable": true,
"quote_count": 0,
"reply_count": 0,
"retweet_count": 17,
"retweeted": false,
"user_id_str": "1585782103836217344",
"id_str": "1825787924748890186"
}
}
},
"tweetDisplayType": "Tweet",
"hasModeratedReplies": false
}
}
}
]
},
{
"type": "TimelineTerminateTimeline",
"direction": "Top"
}
]
}
}
}Thanks for @jarz76 's assistance.
They changed their cdn domain video.twimg.com -> video-cf.twimg.com.
This change cause video to be filtered.
The new version might take some time to publish to the store. Please be patient.
https://github.com/EltonChou/TwitterMediaHarvest/blob/d84c93743141f25e4f75651bac915638566c252b/src/backend/downloads/MediaDownloader.ts#L54 https://github.com/EltonChou/TwitterMediaHarvest/blob/d84c93743141f25e4f75651bac915638566c252b/src/backend/downloads/utils/checker.ts#L1-L6
EltonChou
commented
3 months ago Here is new version (dev version). I can't reproduce this issue in my environment, need someone to help testing the failed video tweet. mediaharvest-v4.2.8-pre.zip
jarz76
commented
3 months ago Here is new version (dev version). I can't reproduce this issue in my environment, need someone to help testing the failed video tweet. mediaharvest-v4.2.8-pre.zip
i've tried it, and it works well!
https://github.com/user-attachments/assets/fb14a19f-56e7-40c9-95ad-a04df7555271
EltonChou
commented
3 months ago @jarz76 Thanks for your testing. I will publish it later.
the tool will not download these GIFs, but acts as tho it has: https://x.com/i/web/status/1824213688762720580 https://x.com/AkiyoshiKitaoka/status/1824978689144369397 https://x.com/AkiyoshiKitaoka/status/1824966524744224890
could be an edge case, might be important as elon continues to change the platform....
Google Chrome Version 126.0.6478.126 (Official Build) (64-bit)