Scraper Check 11/00/2018

[jewbmx]

Scraper Check 11-08-2018 (Double Check My Findings!) (Tested by hand in browser and 1by1 in my Scrubs addon.) (Droid s7 edge iowa, usa)

_enDbird

• tvbmoviez.py # Needs removed, Broken dupe for bestmovies.

_DbirdBroke

• phazeddl.py # Sites dead and tinydl.com doesnt work.
• power.py # Doesnt work for me, might be me but dont care to look at it.
• sceper.py # Sites dead doubt its ever coming back.
• wrzcraft.py # Sites 'Down for Maintenance' but says they moved to http://new.wrzcraft.net . (Think i tested the new.wrzcraft.net and still was broke.)

_Dbird2Fix

• ddlvalley.py # Site works fine.
• gomovies.py # ddos/cf cockblock
• rlsscn.py # Site works fine. (has another domain too http://tvdownload.net)
• scenerls.py # ddos/cf cockblock
• seriescr.py # Site works fine. (These can most likely be fixed maybe, Im not gonna tho.)

_DbirdFixed

• bestmoviez.py # fixed with cfscrape.
• moviesonline.py # Added new domains i found. (feel free to hunt for a alternate domain for bestmoviez.py) (http://jewrepo.cf/JewRepo/4git/) (Hosting these for about 1 week then they will be deleted.)

_DbirdWorked

• 2ddl.py
• 300mbfilms.py
• directdl.py
• myvideolink.py
• rlsbb.py
• ultrahdindir.py

[doko-desuka]

The resolve( ) function on each scraper is only called when the user tries to play an item from the "PROVIDER | hostname" list after everything has been scraped.
Some websites (called "providers") hide the final address to the host with the video behind a hashed request (like http\:\/\/m.primewire.gr/go.php?id=1692865, which returns something like https\:\/\/openload.co/embed/Tt0V8lttcEI).
That's why the resolve( ) function is needed, so you can lazily ask the source website for a single item, the one that the user chose to play. This saves bandwidth.

That being said, what the heck is ip_player, a simple search doesn't find it =(

[jewbmx]

The issue seems to be something with this... (havent bothered with it yet personally lol.)

def resolve(self, url):
    try:
        urldata = urlparse.parse_qs(url)
        urldata = dict((i, urldata[i][0]) for i in urldata)
        post = {'ipplugins': 1,'ip_film': urldata['data-film'], 'ip_server': urldata['data-server'], 'ip_name': urldata['data-name'],'fix': "0"}
        p1 = client.request('http://0123movies.org/ip.file/swf/plugins/ipplugins.php', post=post, referer=urldata['url'], XHR=True)
        p1 = json.loads(p1)
        p2 = client.request('http://0123movies.org/ip.file/swf/ipplayer/ipplayer.php?u=%s&s=%s&n=0' %(p1['s'],urldata['data-server']))
        p2 = json.loads(p2)
        p3 = client.request('http://0123movies.org/ip.file/swf/ipplayer/api.php?hash=%s' %(p2['hash']))
        p3 = json.loads(p3)
        n = p3['status']
        if n == False:
            p2 = client.request('http://0123movies.org/ip.file/swf/ipplayer/ipplayer.php?u=%s&s=%s&n=1' %(p1['s'],urldata['data-server']))
            p2 = json.loads(p2)
        url =  "https:%s" %p2["data"].replace("\/","/")
        return url
    except:
        return

[doko-desuka]

Try this:

def resolve(self, url):
    try:
        urldata = urlparse.parse_qs(url)
        urldata = dict((i, urldata[i][0]) for i in urldata)
        post = {'ipplugins': 1,'ip_film': urldata['data-film'], 'ip_server': urldata['data-server'], 'ip_name': urldata['data-name'],'fix': "0"}
        p1 = client.request('http://0123movies.org/ip.file/swf/plugins/ipplugins.php', post=post, referer=urldata['url'], XHR=True)
        p1 = json.loads(p1)
        p2 = client.request('http://0123movies.org/ip.file/swf/ipplayer/ipplayer.php?u=%s&s=%s&n=0' %(p1['s'],urldata['data-server']))
        p2 = json.loads(p2)
        url =  "https:%s" %p2["data"].replace("\/","/")
        return url
    except:
        return

The api.php call seems to have been removed

[jewbmx]

NoJoy there. Before that change it listed some results that didnt play, now it doesnt find any results for anything.

[doko-desuka]

That function isn't called until you play an item. If it's not even finding any results then there's a syntax error preventing the script to be loaded at all.
Check if the indentation is right (it's supposed to go inside the source class), it usually messes up when it's copy-pasted

[jewbmx]

Ah man your gonna get me sucked in lol, im just chillin watching a christmas story and playing with playlists :p

[jewbmx]

Tried your fix on two different scrapers and no matter how i add the new code it seems to break the scraper and make it not show up at all in the search lol, original scraper still loads. Its a odd issue for sure.

[jewbmx]

Heres a heads up for everyone that uses multiple versions like this lol. Name is the website minus the .dot

Testing on ( Hunter Killer ) (can be 96 results by ditching the first bit.)

moviesonlinefm.py 98 results

moviesonlinegy.py 98 results

moviesonlinela.py 98 results

moviesonlinemn.py 98 results

moviesonlinemx.py 98 results

moviesonlinetl.py 98 results

[jewbmx]

Looks like a few of those scraper issues emailed to me yesterday were just issues with http/https changes.

Im gonna have to redownload a fresh copy of LS and go thru what ya got so your upto date as well.

The past two weeks have been pretty busy in the world of sites and/or scrapers, alot of random petty changes and a few domain swaps.

[jewbmx]

Just did a new PR with todays scraper check and fixed what needed fixin in the normal folder. Someone might wanna check it out, added the notes for it to the pr description

[jewbmx]

Got 3 questions for the "LS peeps"

1. Does anyone wanna test a few scrapers i put in a folder that are halfass working but dont play for me?(maybe even figure out whats wrong with em for me lol)

2. Why do i see 2 different nojoy folders in LS lol?

3. Which one of ya is eggman lmao im always getting new module updates after i update any scrapers so im guessing the pretty man is around here keeping up with us :) (if ya are around then nice job keeping up and kudos to your progress.)

[doko-desuka]

What folder did you put the nonworking ones, exactly?

[jewbmx]

Oh i didnt move or alter anything. Besides deletein that dupe completely lol. I prefer to post notes and let you guys decide what to do with the information.

Both nojoy folders might have dupes inside that are the scrapers before their fix, not sure if i checked after i got done the other day.

Im currently going thru every single lang. folder and plan to add them to a PR for everybody when i get done in a day or two. Been driving myself insane with errors from this stupid rd setting i wanted so i havent made it very far yet with the holiday too lol.

[jewbmx]

Dont remember if i said so yet but im done with all the language scrapers and waiting to be told to upload em by the big boss lol. Still have a couple to test but their domains are up to date and just gotta find a file to try em with.

[jewbmx]

Man im about to throw my phone and quit coding lol i cant figure out why my artwork aka theme option dont work in k18 ExoRedux works and from what i can see my code all matches lol beards gonna go bald over here

*Wow just figured out the issue after a month of messing with it lmao. Forgot to ever do the lib part of the artwork module, feelin dumb today :)

[jewbmx]

I never play around with this scraper but think the Library.py scraper is not working for kodi 18, seen some error for it yesterday on my testapp

Might also be my setup since i dont use it lol