search

Anon-Exploiter / ine-dl

Python script to download INE courses including labs, exercises, quizzes, slides, and, videos!
MIT License
17 stars 8 forks source link

[Code Change] - Fetching video and subs fails with warning of Rate Limiting #9

Closed heliocore56 closed 8 months ago

heliocore56 commented 1 year ago

This issue is appearing constantly. Capture

Anon-Exploiter commented 1 year ago

@heliocore56, did it ever work? If not, feel free to reach out to me on Discord with the creds (Umar_0x01#0079) - Happy to take a look.

Also, make sure to not include the debug flag in any screenshots you post online, the above contains your JWT token which can result in someone taking over your session (if its valid).

vikdean commented 1 year ago

Same here, it was working for me before, but something must have changed on the INE side, because now it doesn't. It just continuously trying to download the same thing, but getting stuck there.

Anon-Exploiter commented 1 year ago

@vikdean can't really do much since I don't have an account, happy to take a look if you can share yours.

vikdean commented 1 year ago

I also used someone else's for a time, but its not something I can share unfortunately.

Anon-Exploiter commented 1 year ago

Can't help then mate.

sulaimanzai commented 11 months ago

they ave added 

> X-RateLimit-Limit: 60                                                                                                                         
> X-RateLimit-Remaining: 59
Anon-Exploiter commented 11 months ago

There should be a way around it. Probably with request throttling, this can be resolved.

@sulaimanzai happy to share INE account?

vikdean commented 10 months ago

Eventhough I cannot share my account itself, I would be happy to share logs or outputs if that would help.

filipkro124 commented 10 months ago

the account if free for 7 days.

jrscrs commented 8 months ago

@Anon-Exploiter I'm able to help, running into the same issue as @heliocore56 and @vikdean, I could share some details so you can have a look. Friended you on discord in order to DM you.

Anon-Exploiter commented 8 months ago

Thanks for helping with the creds @jrscrs, the issue isn't with rate limiting (even though it is implemented and is a pain to deal with).

They've removed the endpoint which fetches API metadata of the videos, my exception is generic so it just keeps refreshing user's token thinking the session expired or is rate limited, probably need to make it better #10

image

I'll have to look at the Android/iOS mobile applications, the flow, their traffic and see how they're implementing the APIs now, I'll see if I can give it any time this weekend. Might require a lot of reparsing and recoding.

Anon-Exploiter commented 8 months ago

This is now fixed in the following commits: https://github.com/Anon-Exploiter/ine-dl/commit/c088b4d4bb66af25ada072b162ae575e823db2bd https://github.com/Anon-Exploiter/ine-dl/commit/3a85458a208eca9add8a9c56532c369f4b4b0509

@heliocore56 @vikdean @sulaimanzai @jrscrs can you please retry?

jrscrs commented 8 months ago

@Anon-Exploiter I can confirm your fixed worked, I successfully downloaded two courses!

Many thanks!

Anon-Exploiter commented 8 months ago

Thanks for the creds and verification mate, closing this issue as fixed.