search

mcrapet / plowshare-modules-legacy

Plowshare legacy & unmaintained modules
GNU General Public License v3.0
122 stars 78 forks source link

1fichier waiting 300s forever #145

Closed legrosgore closed 7 years ago

legrosgore commented 7 years ago

Hi,

I found a strange behavior in 1fichier download : it wait 300s and then wait 300s again and again and again.

Here is the debug log :

  • plowdown -v4 --max-retries=10 -a mymail:mypass -x -o /data/share/media 'https://1fichier.com/?4kyqi1fiuy' rep: === SYSTEM INFO BEGIN === rep: [mach] nas x86_64 linux-gnu x86_64-pc-linux-gnu rep: [bash] 4.3.30(1)-release rep: [env ] http_proxy=http://localhost:3128 rep: [curl] curl 7.38.0 (x86_64-pc-linux-gnu) libcurl/7.38.0 OpenSSL/1.0.1t zlib/1.2.8 libidn/1.29 libssh2/1.4.3 librtmp/2.3 rep: [sed ] License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html. rep: [lib ] '/var/lib/jenkins/local/share/plowshare' rep: === SYSTEM INFO END === rep: plowdown version v2.1.6-14-gbe562b4 (2017-04-02) Output directory: /data/share/media dbg: plowdown: --no-overwrite selected rep: use /var/lib/jenkins/.config/plowshare/plowshare.conf Starting download (1fichier): https://1fichier.com/?4kyqi1fiuy Starting login process:mymail/**** rep: --insecure --compressed --speed-time 600 --connect-timeout 240 --user-agent Mozilla/5.0 (X11; Linux x86_64; rv:6.0) Gecko/20100101 Firefox/6.0 --silent --cookie-jar /tmp/plowdown.1667.16696 --data mail=my_mail&pass=mypass&lt=on&purge=on&secure=on&Login=Login https://1fichier.com/login.pl rep: Received 5673 bytes. DRETVAL=0 rep: === CURL BEGIN === rep:<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" rep: "http://www.w3.org/TR/html4/strict.dtd"> rep: rep: rep: 1fichier.com: Cloud Storage rep: rep: rep: rep: rep: rep:
    rep: rep: rep: rep: rep:
    rep: rep:
    rep:
    rep: rep: Vous êtes connecté. Cette page va se raffraichir automatiquement. rep:
    Si rien ne se produit, veuillez cliquer ici. rep:
    rep:
    You are logged in. This page will redirect you. rep:
    If nothing happens, click here. rep: rep:
    rep: rep:
    rep:
    rep: rep: rep: rep: === CURL END === rep: === COOKIE BEGIN === rep:# Netscape HTTP Cookie File rep:# http://curl.haxx.se/docs/http-cookies.html rep:# This file was generated by libcurl! Edit at your own risk. rep: rep:.1fichier.com TRUE / FALSE 1496265585 SID mUvFHAEa8r9N4M9plVxypT9qYFNCQqjHTlwQLqLZ9Egg6PN5Oo7jQ4SEjMj9dqLS rep: === COOKIE END === dbg: storage_set: cookie_file' set for module1fichier' dbg: session (new): 'mUvFHAEa8r9N4M9pbYxypT8qYFNCQqjHTlwQLqLX9Egg6PN5Oo7jQ4SEjMj3vqLS' rep: --insecure --compressed --speed-time 600 --connect-timeout 240 --user-agent Mozilla/5.0 (X11; Linux x86_64; rv:6.0) Gecko/20100101 Firefox/6.0 --silent --head -b /tmp/plowdown.1667.16696 https://1fichier.com/?4kyqi1fiuy rep: Received 286 bytes. DRETVAL=0 rep: === CURL BEGIN === rep:HTTP/1.1 200 Connection established rep: rep:HTTP/1.1 200 OK rep:Server: nginx rep:Date: Mon, 01 May 2017 19:19:45 GMT rep:Content-Type: text/html; charset=utf-8 rep:Connection: keep-alive rep:Vary: Accept-Encoding rep:Cache-Control: no-cache rep:Expires: Fri, 30 Oct 1998 14:19:41 GMT rep:Content-Encoding: gzip rep: rep: === CURL END === rep: --insecure --compressed --speed-time 600 --connect-timeout 240 --user-agent Mozilla/5.0 (X11; Linux x86_64; rv:6.0) Gecko/20100101 Firefox/6.0 --silent --form-string links[]=https://1fichier.com/?4kyqi1fiuy https://1fichier.com/check_links.pl rep: Received 90 bytes. DRETVAL=0 rep: === CURL BEGIN === rep:https://1fichier.com/?4kyqi1fiuy;Suits.S04E03.FRENCH.LD.HDTV.x264-AUTHORiTY.mkv;264029981 rep: === CURL END === rep: --insecure --compressed --speed-time 600 --connect-timeout 240 --user-agent Mozilla/5.0 (X11; Linux x86_64; rv:6.0) Gecko/20100101 Firefox/6.0 --silent -b LG=en https://1fichier.com/?4kyqi1fiuy rep: Received 24901 bytes. DRETVAL=0 rep: === CURL BEGIN === rep:<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" rep: "http://www.w3.org/TR/html4/strict.dtd"> rep: rep: rep: 1fichier.com: Cloud Storage rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep:
    rep: rep: rep: rep: rep:
    rep:
    rep: rep:
    rep:
    rep: rep: rep: rep: rep: rep: rep: rep:
    rep: rep:
    rep: rep:
    rep: rep:
    rep:
    Pay Offers
    rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep:
     FreeRegisteredAccessPremium
    Download Speedvery limitedlimitedUnlimited (non premium networks )Unlimited
    AdvertisementsYesNo
    Download priorityNoYes
    IP address priorityNoYes
    IP authenticationNoYes
    CDN CreditsNo100 GB / month
    Wait between downloadsYesNo
    Download managersNoYes
    Simultaneous downloadsNoYes
    Maximum File Size (send)100 GB
    Maximum File Size (receive)5 GB50 GB100 GB
    Storage spaceNo1 TBUnlimited
    Retention of files15 days after the last download30 days after the last downloadUnlimited
    Resuming downloadsNoYes
    Remote UploadNoYes
    FTP UploadNoYes
    Password ProtectionYes
    Access list controlNoYes
    rep:
    rep: The Access offer do not include "Premium" networks. rep:
    Test your download speed on the Network page rep:
    rep: rep:
    rep: rep:
    rep:
    rep: After test for FREE our services, choose your Offer : rep: rep: rep: 1st May discount: up to 66% off ! rep: rep: rep: rep: rep:
    Premium Offer
    rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep:
    24 h1 month3 months6 months1 YearLifeTime
    1 €3 €9 €15 €10 €99 €
    paymentpaymentpaymentpaymentpaymentpayment
    rep: rep:
    Access Offer
    rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep:
    24 h1 month6 months1 Year
    < 1 €1 €6 €5 €
    paymentpaymentpaymentpayment
    rep:
    rep:
    rep: rep: Prices starting from, depending on the payment method  rep: Pricing Policy rep:
    rep: rep: rep:
    rep:
    rep:
    rep: rep:
    rep: rep:
    rep: rep: rep: rep: rep: rep:
    rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep:
    rep:
    rep:
    File Name :Suits.S04E03.FRENCH.LD.HDTV.x264-AUTHORiTY.mkv
    Date :22/04/2015
    Size :251.80 MB
    rep: rep:
    rep: rep:
    rep:
    rep: rep:
    rep:
    rep:  Download without SSL encryption rep: rep:  Inline Download rep: rep:
    rep: rep: rep:
    rep:
    rep: rep: rep: rep:
    rep:
    rep: rep: rep: rep: rep: rep: rep:
    rep:
    rep:
    rep: rep:
    rep:
    rep: rep: rep: rep:
    rep: rep: rep: rep:
rep:
rep: rep: rep: rep:
rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep: rep: rep: rep: rep: rep:
rep: rep: rep: rep: === CURL END === rep: --insecure --compressed --speed-time 600 --connect-timeout 240 --user-agent Mozilla/5.0 (X11; Linux x86_64; rv:6.0) Gecko/20100101 Firefox/6.0 --silent --include -b /tmp/plowdown.1667.16696 -b LG=en -d --referer https://1fichier.com/?4kyqi1fiuy https://1fichier.com/?4kyqi1fiuy rep: Received 24447 bytes. DRETVAL=0 rep: === CURL BEGIN === rep:HTTP/1.1 200 Connection established rep: rep:HTTP/1.1 200 OK rep:Server: nginx rep:Date: Mon, 01 May 2017 19:19:49 GMT rep:Content-Type: text/html; charset=utf-8 rep:Transfer-Encoding: chunked rep:Connection: keep-alive rep:Vary: Accept-Encoding rep:Cache-Control: no-cache rep:Expires: Fri, 30 Oct 1998 14:19:41 GMT rep:Last-Modified: Wed, 22 Apr 2015 14:04:06 GMT rep:Content-Encoding: gzip rep: rep:<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" rep: "http://www.w3.org/TR/html4/strict.dtd"> rep: rep: rep: 1fichier.com: Cloud Storage rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep:
rep:
rep: rep:
rep:
rep: rep: rep: rep: rep: rep: rep:
rep: rep:
rep: rep:
rep: rep:
Pay Offers
rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep:
 FreeRegisteredAccessPremium
Download Speedvery limitedlimitedUnlimited (non premium networks )Unlimited
AdvertisementsYesNo
Download priorityNoYes
IP address priorityNoYes
IP authenticationNoYes
CDN CreditsNo100 GB / month
Wait between downloadsYesNo
Download managersNoYes
Simultaneous downloadsNoYes
Maximum File Size (send)100 GB
Maximum File Size (receive)5 GB50 GB100 GB
Storage spaceNo1 TBUnlimited
Retention of files15 days after the last download30 days after the last downloadUnlimited
Resuming downloadsNoYes
Remote UploadNoYes
FTP UploadNoYes
Password ProtectionYes
Access list controlNoYes
rep:
rep: The Access offer do not include "Premium" networks. rep:
Test your download speed on the Network page rep:
rep: rep: rep:
rep:
rep: After test for FREE our services, choose your Offer : rep: rep: rep: 1st May discount: up to 66% off ! rep: rep: rep: rep: rep:
Premium Offer
rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep:
24 h1 month3 months6 months1 YearLifeTime
1 €3 €9 €15 €10 €99 €
paymentpaymentpaymentpaymentpaymentpayment
rep: rep:
Access Offer
rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep: rep:
24 h1 month6 months1 Year
< 1 €1 €6 €5 €
paymentpaymentpaymentpayment
rep:
rep:
rep: rep: Prices starting from, depending on the payment method  rep: Pricing Policy rep:
rep: rep:
rep:
rep: Your download speed will be limited to 800 KB/s. rep:
For a high quality service, subscribe ! rep:
rep:
rep: rep: rep: rep:
rep: Click here to download the file rep:
rep: rep: rep: rep: rep: rep: rep:
rep:
rep:
rep: rep:
rep:
rep: rep: rep: rep: rep:
rep: rep:   rep:
rep:
rep: rep: rep: rep:
rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep:
rep: rep: rep: rep: rep: rep:
rep: rep: rep: rep: === CURL END === dbg: arbitrary wait (from module) Waiting 300 seconds...

I tried to fix it myself, so i did :

iff --git a/1fichier.sh b/1fichier.sh
index 260dac2..d349e67 100644
 --- a/1fichier.sh
 +++ b/1fichier.sh
 @@ -193,11 +193,11 @@ MODULE_1FICHIER_PROBE_OPTIONS=""
          --referer "$URL" "$URL") || return

      # To help you discover our services, we will not limit your download speed.
 -    if match 'discover\(.*\) our services\(.*\) your download speed' "$PAGE"; then
 +#    if match 'discover\(.*\) our services\(.*\) your download speed' "$PAGE"; then
          FILE_URL=$(parse 'class="ok btn-general btn-orange"' '<a href="\(.*\)"  style' <<< "$PAGE")
 -    else
 -        FILE_URL=$(grep_http_header_location_quiet <<< "$PAGE")
 -    fi
 +#    else
 +#        FILE_URL=$(grep_http_header_location_quiet <<< "$PAGE")
 +#    fi

      if [ -z "$FILE_URL" ]; then
          echo 300

and it seems to work. Could you please make the change on the git repository ? Thanks