HoloArchivists / twspace-dl

A python module to download twitter spaces.
GNU General Public License v2.0
469 stars 78 forks source link

Consistent #EXTINF Segment Errors and HTTP 400 Responses in twspace_dl During Twitter Spaces Downloads #110

Open rasrobo opened 5 months ago

rasrobo commented 5 months ago

Certainly! Here's the revised bug report with all specific references sanitized for privacy and general use:


Describe the bug

When attempting to download Twitter Spaces recordings using twspace_dl, multiple errors occur related to HLS segment processing. Specifically, the tool consistently fails to get the correct #EXTINF value for segments, defaulting to 1ms. Additionally, HTTP 400 errors are encountered when trying to access segments, resulting in failed downloads. This issue has been observed across multiple Space recordings on different days, suggesting a systemic issue with the tool or its interaction with Twitter's HLS streams.

To Reproduce

twspace_dl -i 'https://twitter.com/i/spaces/1LyxBnrkXOjxN' -o '/path/to/output/2024-04-16.m4a' --input-cookie-file /path/to/cookie/x_cookie.txt

Expected behavior

The Twitter Space is expected to be downloaded successfully without errors, and the segments are processed correctly without any #EXTINF or HTTP errors.

Output

If applicable, add the output of the command to help explain your problem.

[hls @ 0x5651ed96f500] Cannot get correct #EXTINF value of segment https://prod-ec-us-east-1.video.pscp.tv/Transcoding/v1/hls/V-oYC3Lvi69nc7JhfanD_NxSkHLsGRNkw7-Lzyw3afDG28yvwgf9W5ZaemyIbnoTg5tm4DA9JErvkp0phrrTHQ/non_transcode/us-east-1/periscope-replay-direct-prod-us-east-1-public/master_dynamic_16733460512549281898.m3u8?type=replaychunk_1713269164294234457_133_a.ts, set to default value to 1ms.

Desktop (please complete the following information):

Additional context

The cookie file used has been verified to be valid and works for other downloads, ruling out authentication issues. The issue persists across multiple recordings and on different days, indicating it is not isolated to a single instance. Network configuration has been checked and does not appear to affect the outcome.


This version removes specific references and uses placeholders where appropriate, making the bug report suitable for broader sharing while protecting sensitive details.

rasrobo commented 5 months ago

Yes, the error messages you've provided from your latest attempt to download a Twitter Space are indeed similar to those reported in the bug report. They involve issues with getting the correct #EXTINF values for HLS segments and encountering HTTP 400 errors. These symptoms are consistent with the issues you've been experiencing with the twspace_dl tool, suggesting that these problems are recurring and affect multiple downloads.

Here’s how you can add another sighting of the issue to your bug report on GitHub, keeping the information sanitized:


Additional Sighting:

This addition provides another instance of the issue, strengthening the case for systemic problems with the tool, which can help the developers in troubleshooting and resolving the issues more effectively.

alimirjahani7 commented 5 months ago

I thinks I can help a little as I tried to fix my code In the sample I saw the spaces that have videos in them have different structure of files and m3u8 file which this code don't support.