lay295 / TwitchDownloader

Twitch VOD/Clip Downloader - Chat Download/Render/Replay
MIT License
2.53k stars 260 forks source link

Possible to get chat from Kick vods? #761

Open churrodude666 opened 11 months ago

churrodude666 commented 11 months ago

Checklist

Write your feature request here

Hi, I fully respect if this 'request' gets removed immediately, because obviously it relates to Kick and not Twitch. But I saw a reddit post that seems to imply that it's possible to grab chats from Kick api's in a similar way to how we currently can here. Is this something that's possible?

Again, I hope this comes across as a harmless request, and I apologise if it doesn't. Thank you for all you do in helping us get material that these companies seem so intent from keeping from us for some reason ❤

ScrubN commented 11 months ago

Kick still does not have any form of VOD chat replay. When they eventually add chat replays then we can revisit this feature but as it stands this is just not possible.

churrodude666 commented 11 months ago

Kick still does not have any form of VOD chat replay. When they eventually add chat replays then we can revisit this feature but as it stands this is just not possible.

Oh yeah, I know that. But this post (which I should have linked initially) seems to imply the logs of streamers can still be accessed somehow: https://www.reddit.com/r/xqcow/comments/14m2jyt/watch_kick_vods_with_chat/

Unfortunately I'm a novice, which is why I figured I'd ask here. If it's not possible, then is what it is I guess.

lay295 commented 11 months ago

Kick still does not have any form of VOD chat replay. When they eventually add chat replays then we can revisit this feature but as it stands this is just not possible.

Oh yeah, I know that. But this post (which I should have linked initially) seems to imply the logs of streamers can still be accessed somehow: https://www.reddit.com/r/xqcow/comments/14m2jyt/watch_kick_vods_with_chat/

Unfortunately I'm a novice, which is why I figured I'd ask here. If it's not possible, then is what it is I guess.

They're probably storing the chat messages live as they happen, and I don't think livestream recording will be in the scope of this program.

It would be cool for this to download more than just Twitch, maybe for YouTube could be a wrapper for yt-dlp and could implement our own stuff for Kick. It would be a lot of work to add an abstraction layer on everything since everything assumes it's Twitch, but whenever kick does add that to their API it's something we'll explore.

ScrubN commented 11 months ago

They are indeed capturing chat messages as they come in as evident by some of their comments in the reddit thread and the scarce selection of streamers with available chats. They do have an exposed API for seeing these messages but it would be best to ask for permission to add it to the application. https://kickvod.com/api/messages/xqc?start=1690772058869&end=1690772068869

lay295 commented 11 months ago

Oh... looks like kick added chat to VODs

ScrubN commented 11 months ago

It seems they have. Unfortunately it seems they aren't using a cursor like Twitch, but on the plus side this might also be able to access offline messages as well image

I stand corrected, it does have a cursor, but it's not in the same format as twitch image

Also message.created_at is rounded to the nearest second. Sounds like I'll have to bring back the old dispersion algorithm. image

churrodude666 commented 9 months ago

Was there any luck with this?

ILoveJRock commented 9 months ago

Was there ever any resolution to this?

churrodude666 commented 9 months ago

Was there ever any resolution to this?

I wish. I am beyond desperate lol

ILoveJRock commented 9 months ago

Honestly would pay for someone to develop something to scrape the timestamped chat messages from the full stream. Even if I have to play the full stream to collect the chat messages.

lay295 commented 9 months ago

I mean, if you guys want something, you can try this build. Here if a kick chat of xQc I rendered a while ago.

https://drive.google.com/file/d/1hbOU4YNdc7v_UNLM6n4XW4ncYH0Qtizm/view?usp=drive_link (You'll get prompted to update the version, just hit "Skip this version")

This is still very much a work in progress (since Kick makes it hard to get their data) and only the "VOD Download", "Clip Download", "Chat Download", and "Chat Render" tabs have been tested. Many things still not working yet

churrodude666 commented 9 months ago

I get hit with a 'unable to get video/clip information. Please double check link and try again' error. 😔

lay295 commented 9 months ago

I get hit with a 'unable to get video/clip information. Please double check link and try again' error. 😔

What's the link and which tab of the downloader?

churrodude666 commented 9 months ago

I get hit with a 'unable to get video/clip information. Please double check link and try again' error. 😔

What's the link and which tab of the downloader?

I've tried a couple of different streams on both the vod and chat downloads, it's probably something I'm doing wrong. Is there a particular part of the url that would count as it's id?

lay295 commented 9 months ago

I get hit with a 'unable to get video/clip information. Please double check link and try again' error. 😔

What's the link and which tab of the downloader?

I've tried a couple of different streams on both the vod and chat downloads, it's probably something I'm doing wrong. Is there a particular part of the url that would count as it's id?

You'd put the whole URL in not just the link

churrodude666 commented 9 months ago

I get hit with a 'unable to get video/clip information. Please double check link and try again' error. 😔

What's the link and which tab of the downloader?

I've tried a couple of different streams on both the vod and chat downloads, it's probably something I'm doing wrong. Is there a particular part of the url that would count as it's id?

You'd put the whole URL in not just the link

I get hit with a 'unable to get video/clip information. Please double check link and try again' error. 😔

What's the link and which tab of the downloader?

I've tried a couple of different streams on both the vod and chat downloads, it's probably something I'm doing wrong. Is there a particular part of the url that would count as it's id?

You'd put the whole URL in not just the link

Full url was what I was initially trying. Reinstalled it, same issue kick help kick help 2

ILoveJRock commented 9 months ago

Just crashes for me as well when I try to download a VOD's chat, understandable since Kick probably changed how the chat is stored / received since they're going live with their API soon. Submitted a request for access to their API when it does go live to hopefully make an official tool that will do this.

lay295 commented 9 months ago

Weird, maybe somehow kick is detecting it's a bot still somehow or my libcurl calls aren't working properly.

What version of Windows are you on? 64-bit? Again haven't tested it that much beyond the initial testing but that VOD is working for me.

image

Just crashes for me as well when I try to download a VOD's chat, understandable since Kick probably changed how the chat is stored / received since they're going live with their API soon. Submitted a request for access to their API when it does go live to hopefully make an official tool that will do this.

I wonder if they would even approve of this type of tool, my guess is no but we'll see. I submitted an application as well.

ILoveJRock commented 9 months ago

Some weird bug with caching or something. Moved my cache folder to a folder on my desktop instead of the default and now it gets to 5% before closing where it was closing at 0% XD.

VOD Downloading is working perfectly fine now, but the one I'm needing is the chat which isn't going through

Win 10 64 bit but think it might be some issue with my computer, gonna try it on my laptop today and see if that fixes it.

churrodude666 commented 8 months ago

Have now tried on a windows 10 64 bit and as opposed to before, can find the vods, but it insta closes on 0% of the chat download now too

DMN7 commented 7 months ago

just looking to get an update on this, is it working for vods and chat now?

Devin2019chs commented 7 months ago

Hello,

I would love to use this tool to obtain chats from Kick VODS. What is the status on it now?

ScrubN commented 7 months ago

You can compile the branch and run it yourself now, it is mostly functional. Build instructions can be found in the README, the hardest part is cloning the kick-support branch instead of master.

Some features like embedded data are not yet implemented for kick chats though, and there is no guarantee that kick chats from now will remain compatible.

On Fri., Nov. 24, 2023, 10:14 p.m. Devin2019chs, @.***> wrote:

Hello,

I would love to use this tool to obtain chats from Kick VODS. What is the status on it now?

— Reply to this email directly, view it on GitHub https://github.com/lay295/TwitchDownloader/issues/761#issuecomment-1826199345, or unsubscribe https://github.com/notifications/unsubscribe-auth/ARGBYQK23D33VTIIGAE573DYGFO7ZAVCNFSM6AAAAAA24TMZGWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMRWGE4TSMZUGU . You are receiving this because you commented.Message ID: @.***>

churrodude666 commented 6 months ago

You can compile the branch and run it yourself now, it is mostly functional. Build instructions can be found in the README, the hardest part is cloning the kick-support branch instead of master. Some features like embedded data are not yet implemented for kick chats though, and there is no guarantee that kick chats from now will remain compatible. On Fri., Nov. 24, 2023, 10:14 p.m. Devin2019chs, @.> wrote: Hello, I would love to use this tool to obtain chats from Kick VODS. What is the status on it now? — Reply to this email directly, view it on GitHub <#761 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ARGBYQK23D33VTIIGAE573DYGFO7ZAVCNFSM6AAAAAA24TMZGWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMRWGE4TSMZUGU . You are receiving this because you commented.Message ID: @.>

Hi 99% sure this is my end, but I have no idea how to fix this. Any ideas? on me

ScrubN commented 6 months ago

Hi 99% sure this is my end, but I have no idea how to fix this. Any ideas? on me

Please fully uninstall all .NET SDKs from your computer, reboot, then reinstall the .NET6 SDK.

Afterwards, run the command where dotnet in your terminal and ensure it responds with C:\Program Files\dotnet\dotnet.exe. If it responds with C:\Program Files (x86)\dotnet\dotnet.exe, you must use the system environment variables editor to reorder the dotnet entries in the Path variable so non-x86 comes first. image image image image

churrodude666 commented 4 months ago

Hi, I know it's been 2 months but I didn't just abruptly leave without thanking you for the build and your hard work. My health took a bit of a battering, and with that, I still never got the Kick build working lol.

I built it from source, but got the same issue as #920 and I think it's because of how I restore dotnet. Unfortunately I can't use the fix referenced because I have no 'Curl-impersonate' folder. When I restore dotnet I have to specify a project, but I'm not sure what that is, as I've tried 'TwitchDownloaderWPF' as the project, but still end up with the same issue, and no curl impersonate folder.

Edit: Disregard, I'm not sure what I did differently today, but I got it working! Huzzah, you guys are awesome man.