edhaker13 / myanimelist

MyAnimeList plugin for FlexGet
10 stars 3 forks source link

RequestException: 502 Server Error: Bad Gateway #3

Closed ghost closed 10 years ago

ghost commented 10 years ago

Hi, First thank's a lot of your time on this.

Fell days I have this problem, Some help? :)

2013-10-19 18:54 VERBOSE myanimelist Anime Retrieving MyAnimeList on u'http://mal-api.com/animelist/WhiteWK' . 2013-10-19 18:54 CRITICAL plugin Anime RequestException: 502 Server Error: Bad Gateway

Using last update of myanimelist.py

edhaker13 commented 10 years ago

Hi there, First of all thanks for using my plug in and making an issue =)

That error means the API server is misconfigured or just not available.

I am looking into putting mirrors in case this starts happening frequently. Usually it will come back only after a few hours.

Btw the I'm not hosting the server, so I have no means to put it back online. On 22 Oct 2013 04:00, "WhiteWK" notifications@github.com wrote:

Hi, First thank's a lot of your time on this.

Fell days I have this problem, Some help? :)

2013-10-19 18:54 VERBOSE myanimelist Anime Retrieving MyAnimeList on u' http://mal-api.com/animelist/WhiteWK' . 2013-10-19 18:54 CRITICAL plugin Anime RequestException: 502 Server Error: Bad Gateway

Using last update of myanimelist.py

— Reply to this email directly or view it on GitHubhttps://github.com/edhaker13/myanimelist/issues/3 .

ghost commented 10 years ago

Understand now. ..All link's for the API from mal-api.com is offline now, only option is waiting for fixing it, One more time, thank's for your time.

ghost commented 10 years ago

mal-api.com stopped working again today. It's possible when fail to connect use cache instead?

edhaker13 commented 10 years ago

Sorry WhiteWK I had no time to fix this, but I managed to get white listed on the official API all calls are now routed through them. You should be able to use it as usual now :)

ghost commented 10 years ago

Hi edhaker13, thank's for nice update. I'm tested, but give me this error. (Using simple config.yml)

2014-01-09 23:01 VERBOSE myanimelist Animes_ptw Retrieving MyAnimeList on http://myanimelist.net/malappinfo.php?u=WhiteWK&status=all&type=anime. 2014-01-09 23:01 ERROR task Animes_ptw BUG: Unhandled error in plugin import_series: 'unicode' object has no attribute 'etree' Traceback (most recent call last): File "C:\Python27\lib\site-packages\flexget\task.py", line 365, in run_plugin return method(_args, *_kwargs) File "C:\Python27\lib\site-packages\flexget\event.py", line 21, in __call* return self.func(_args, _kwargs) File "C:\Python27\lib\site-packages\flexget\plugins\plugin_import_series.py", line 65, in on_task_start result = method(task, input_config) File "C:\Python27\lib\site-packages\flexget\event.py", line 21, in call* return self.func(_args, _kwargs) File "C:\Python27\lib\site-packages\flexget\utils\cached_input.py", line 136, in wrapped_func response = func(_args, _kwargs) File "C:\Python27\lib\site-packages\flexget\plugin.py", line 122, in wrapped_func return func(_args, _kwargs) File "C:\Python27\lib\site-packages\flexget\plugins\myanimelist.py", line 137, in on_task_input data = self.parse_xml(resp.text) File "C:\Python27\lib\site-packages\flexget\plugins\myanimelist.py", line 96, in parse_xml except xml.etree.ElementTree.ParseError: AttributeError: 'unicode' object has no attribute 'etree'

Sorry for take your time and thank you in advance for your attention.

edhaker13 commented 10 years ago

Sorry for the delay, could you please test this? Thanks

ghost commented 10 years ago

Ok, fixed the error. But.. now script stop after retrieving and not show any useful information, only this..

2014-01-23 00:45 VERBOSE manager Not running database cleanup on manual run. It will be run on next --cron run. 2014-01-23 00:45 VERBOSE myanimelist Animes_ptw Retrieving MyAnimeList on http://myanimelist.net/malappinfo.php?u=WhiteWK&status=all&type=anime. 2014-01-23 00:45 CRITICAL plugin Animes_ptw
2014-01-23 00:45 INFO task Animes_ptw Aborting task (plugin: import_series)

*Update Sorry for lack information. Here using mode --debug

2014-01-24 01:17 DEBUG task Animes_ptw executing Animes_ptw 2014-01-24 01:17 DEBUG task Animes_ptw resetting Animes_ptw 2014-01-24 01:17 DEBUG task Animes_ptw starting session 2014-01-24 01:17 DEBUG input_cache Animes_ptw cache name: myanimelist_a2ba8ecfe41beee4dc0a572c9e15344d (has: ) 2014-01-24 01:17 DEBUG myanimelist Animes_ptw Starting MyAnimeList plugin 2014-01-24 01:17 VERBOSE myanimelist Animes_ptw Retrieving MyAnimeList on http://myanimelist.net/malappinfo.php?u=WhiteWK&status=all&type=anime. 2014-01-24 01:17 DEBUG plugin Animes_ptw decorator caught ValueError 2014-01-24 01:17 CRITICAL plugin Animes_ptw
2014-01-24 01:17 INFO task Animes_ptw Aborting task (plugin: import_series) 2014-01-24 01:17 DEBUG manager Shutting down 2014-01-24 01:17 DEBUG manager Shutdown completed

edhaker13 commented 10 years ago

Hi White, sorry I've been a bit busy. Could you paste your config so I can and try to trace that error?

ghost commented 10 years ago

Fine. Sure, I'll show you, but it's pretty messy, :P Using:

My Config.yml

presets:
  global:
    domain_delay:
      bt-chat.com: 15 seconds
      torrentz.eu: 15 seconds
      kat.ph: 15 seconds
      ezrss.it: 15 seconds
      h33t.com: 15 seconds
      torlock.com: 15 seconds
      tokyotosho.info: 15 seconds
      nyaa.eu: 15 seconds
    verify_ssl_certificates: no
    regexp:
      reject:
        - \b(duo|tri|quadri|tetra|penta)logy\b: {from: title} 
        - \b3-?D\b: {from: title}                             
        - \btrailer\b: {from: title}                          
        - \bR5\b: {from: title}                               
        - \bWEBSCR\b: {from: title}                           
        - \bscreener\b: {from: title}
        - \bTS\b: {from: title}
        - \bCam\b: {from: title}
        - \bRAW\b: {from: title}
        - \bSpeed.Cd\b: {from: title} #slow
        - \baac2 #no aac2 {from: title}
    manipulate:
      - url:
          replace:
            regexp: '&'
            format: '&'
      - filename:
          from: title
      - title:
          extract: .*\[\s*(.*)\s*\]-.*
          replace:            
            regexp: '[\.-]'
            format: ' '
      - title:
          replace:            
            regexp: '[.]'
            format: ' '
      - title:
          replace:            
            regexp: '[_]'
            format: ' '
    torrent_alive:
      min_seeds: 10
      reject_for: 3 hours
    free_space:
      path: 'X:\Downloads'
      space: 5000
    content_filter:
      require:
        - '*.avi'
        - '*.mkv'
        - '*.mp4'
        - '*.zip'
        - '*.rar'
      reject:
        - 'password.txt'
        - '*.wmv'
    deluge:
      host: 127.0.0.1
      port: 58846
      ratio: 0.01
      removeatratio: yes
      user: kvx
      pass: kvx

  emailfeed:
    rss:
      url: file:///C://rss/download.rss
      link:
        - link
        - magneturi
    disable_builtins: [seen]
    accept_all: yes
#email configuration.
    include: [ private/smtp.yml ]

  rssout:
    make_rss:
      file: C:\rss\download.rss
      days: 1

  anime_input:
    inputs:
      - rss: http://www.nyaa.se/?page=rss&cats=1_37&filter=2
      - rss: http://www.tokyotosho.info/rss.php?filter=1
      - rss: http://kickass.to/anime/?rss=1

  animeOST_input:
    inputs:
      - rss: http://www.nyaa.se/?page=rss&cats=3_14&filter=2

  moviePT_input:
    inputs:
      - rss: http://kickass.to/usearch/dublado%20category%3Amovies/?rss=1 #dublado
      - rss: http://pbay.maxters.net/search/dublado/0/99/0?tld=sx #dublado, tweak custom url from TPB see in 'maxters.net/services/tpb/'

  movieENG_input:
    inputs:
      - rss: http://rss.thepiratebay.se/201
      - rss: http://kickass.to/movies/?rss=1
      - rss: http://www.torlock.com/movies/rss.xml
      - rss: http://torrentz.eu/feed_verified?q=movies

  TVseries_input:
    inputs:
      - rss: http://ezrss.it/feed/                                 # EZRSS
      - rss: http://rss.bt-chat.com/?group=3                       # BT-Chat (EZTV)
      - rss: http://rss.bt-chat.com/?group=2                       # BT-Chat (VTV)
      - rss: http://www.torlock.com/television/rss.xml             # TorLock (TV)
      - rss: http://torrentz.eu/feed_verified?q=tv                 # Torrentz (Verified only, TV)
      - rss: http://rss.bt-chat.com/?cat=2                         # BT-Chat (category TV)
      - rss: http://showrss.karmorra.info/feeds/all.rss            # kasmorra all
      - rss: https://rss.thepiratebay.se/208                       # piratebay tvseries

  myTVseries_input:
    import_series:
      from:
        trakt_list:
          username: whitewk
          password: xxxx
          api_key: xxxx
          series: watchlist

  Music_input:
    inputs:
      - rss: http://pbay.maxters.net/search/trance/0/99/0?tld=sx   # Trance

  mal_watch:
    import_series:
      from:
        myanimelist:
          username: whitewk
          list: watching

  mal_ptw:
    import_series:
      from:
        myanimelist:
          username: WhiteWK
          list: plan to watch

  Local_Animes:
    import_series:
      from:
        listdir:
          - X:\Downloads\Anime\

  animes:
    import_series:
      settings:
        identified_by: sequence
        upgrade: yes
        target: 1080p
        timeframe: 3 hours
    trakt_acquired:
      username: whitewk
      password: xxxx
      api_key: xxxx
      type: series
    quality: 
      - 720p+ !aac
    regexp:
      reject:
        - Spanish
        - French
        - Spanish
        - Chinese
    exists_series:
      path: X:\Downloads\Anime\
    thetvdb_lookup: yes
    metainfo_series: yes 
    if:
      - "'01' in title": accept
#      - "'1080p' in title":
#          set:
#            path: X:\Downloads\Anime\{{ series_name }}\1080p\
#      - "'720p' in title":
#          set:
#            path: X:\Downloads\Anime\{{ series_name }}\720p\
      - "'BD' in title":
          set:
            path: X:\Downloads\Anime\{{ series_name }}\BD\
      - "'OVA' in title":
          set:
            path: X:\Downloads\Anime\{{ series_name }}\OVA\

    set:
      path: >
        X:\Downloads\Anime\{{ series_name|replace('/', '_')|replace(':', ' -') }}/{% if series_id_type == 'ep' %}Season {{ tvdb_season|default(series_season) }}/{% endif %}
      content_filename: >
        {{ series_name|replace('/', '_')|replace(':', ' -') }} - {{ tvdb_ep_id|default(series_id) }}{% if tvdb_ep_name|default(False) %} - {{ tvdb_ep_name|replace('/', '_')|replace(':', ' -') }}{% endif %} - {{ quality }}
      queuetotop: yes

  AnimesOST:
    accept_all: yes
    listdir:
      - X:\Downloads\Anime\
    set:
      path: > 
        X:\Downloads\Anime\{{ series_name|replace('/', '_')|replace(':', ' -') }}\OST\
      label: AnimesOST

  AnimeRemote:
    disable_builtins: [seen, seen_info_hash]
    disable_plugin:
      - inputs
      - exists_series
      - regexp
      - content_size
      - torrent_alive
      - remember_rejected
    all_series:
      parse_only: yes
    plugin_priority:
      exec: 0
    listdir: C:\Users\Kvx\Copy\torrents\Anime\
    accept_all: yes
    exec:
      on_output:
        for_accepted: CALL "C:\Users\Kvx\Copy\torrents\Anime\anime_move.lnk" #clean all .torrent file
    set:
      label: Anime-Remote

  Tv-series:
    import_series:
      settings:
        identified_by: ep
        timeframe: 3 hours
        target: 720p+ hdtv+
        upgrade: yes
    trakt_acquired:
      username: whitewk
      password: xxxx
      api_key: xxxx
      type: series
    regexp:
      from: tvdb_genres
      reject:
        - animation
        - documentary
        - talk show
        - game show
        - reality
        - children
        - home and garden
        - food
        - music
        - musical
    series_premiere: yes
    content_size:
      max: 8000
      min: 20
    exists_series:
      - X:\Downloads\TV
    thetvdb_lookup: yes
    require_field:
      - tvdb_ep_air_date
    set:
      path: 'X:\Download\Complete\TV'
      movedone: >
        X:\Downloads\TV\{{ series_name|replace('/', '_')|replace(':', ' -') }}/{% if series_id_type == 'ep' %}Season {{ tvdb_season|default(series_season) }}/{% endif %}
      content_filename: >
        {{ series_name|replace('/', '_')|replace(':', ' -') }} - {{ tvdb_ep_id|default(series_id) }}{% if tvdb_ep_name|default(False) %} - {{ tvdb_ep_name|replace('/', '_')|replace(':', ' -') }}{% endif %} - {{ quality }}
      label: tv

  Tv-Premiere:
    import_series:
      from:
        listdir:
          - X:\Downloads\TV\

  movies:
    import_series:
      settings:
        upgrade: yes
        timeframe: 3 hours
        target: 1080p
        quality: ts+
    content_size: { min: 300, max: 4000, strict: yes}
    imdb_lookup: yes
    imdb:
      min_score: 6.5
      min_votes: 100
      accept_languages: [
        cantonese, chinese, danish, dutch, french, german, icelandic,
        italian, norwegian, japanese, korean, mandarin, english, portuguese,
        spanish, swedish ]
      reject_genres:
        - News
        - Documentary
        - music
        - biography
    trakt_acquired:
      username: whitewk
      password:xxxx
      api_key: xxxx
      type: movies
    queue_movies: yes
    seen_movies: strict
    exists_movie:
      - 'X:\Downloads\Movies\'
    if:
      - not has_field('imdb_id'): reject
      - 'imdb_year < now.year': reject
    set:
      upgrade: yes
      timeframe: 3 hours
      target: 1080p
      quality: webrip-bluray 720p-1080p
      path: >
        X:\Downloads\Movies\{{ imdb_name|replace('/', '_')|replace(':', ' -') }}
      content_filename: <{{ imdb_name|replace('/', '_')|replace(':', ' -') }} ({{ imdb_year }})>

  Movie-Local:
    listdir:
      - X:\Downloads\Movies\
    exists_movie:
      - X:\Downloads\Movies\
    accept_all: yes
    disable_builtins: [seen, seen_info_hash]
    disable_plugin:
      - exists_series
    quality: 1080p
    imdb_lookup: yes
    if:
      - 'imdb_year < now.year': reject
      - "'Dublado' in title":
          set:
            path: >
              X:\Downloads\Movies\{{ imdb_name|replace('/', '_')|replace(':', ' -') }}\Dublado
            content_filename: <{{ imdb_name|replace('/', '_')|replace(':', ' -') }} ({{ imdb_year }})>
    set:
      label: local_movie

  My_movies:
    import_series:
      from:
        trakt_list:
          username: whitewk
          password: xxxx
          api_key: xxxxx
          movies: watchlist
    trakt_acquired:
      username: whitewk
      password: xxxx
      api_key: xxxxx
      type: movies   
    content_size: { min: 300, max: 6000, strict: yes}
    imdb_lookup: yes
    seen_movies: strict
    queue_movies: yes
    proper_movies: yes
    exists_movie:
      - 'X:\Downloads\Movies\'
    set:
      path: >
        X:\Downloads\Movies\{{ imdb_name|replace('/', '_')|replace(':', ' -') }} {% if imdb_year is defined %}({{imdb_year}})
      content_filename: >
        <{{ imdb_name|replace('/', '_')|replace(':', ' -') }} ({{ imdb_year }})>
      label: MyMovie

  K-lite:
    disable_builtins: yes
    disable_plugin:
      - torrent_alive
    regexp:
      accept:
        - 'K-Lite_Codec_Pack_*'
    download:
      path: X:\Downloads\Programs\k-lite\
      overwrite: yes
    html:
      url: http://codecguide.com/download_k-lite_codec_pack_mega.htm
      title_from: url
    set:
      path: >
        X:\Downloads\Programs\k-lite
    deluge: yes

  Music:
    accept_all: yes
    limit_new: 1
    torrent_alive:
      min_seeds: 15
      reject_for: 3 hours
    set:
      path: 'D:\HD\MUSICAS\{{title}}{{filename | pathext}'
    deluge: yes

tasks:
  Animes:
    priority: 10
    preset:
      - anime_input 
      - mal_watch
      - animes
      - rssout

  Animes_ptw:
    priority: 20
    preset:
      - anime_input
      - mal_ptw
      - animes
      - rssout

  Animes_Local:
    priority: 21
    preset:
      - anime_input
      - Local_Animes
      - animes
      - rssout

  AnimesOST:
    priority: 24
    interval: 7 days
    preset:
      - animeOST_input
      - AnimesOST
      - rssout
    manual: yes

  Animes_Remote:
    priority: 25
    preset:
      - AnimeRemote
      - rssout

  tv-series:
    priority: 30
    interval: 3 hours
    preset:
      - TVseries_input
      - myTVseries_input
      - Tv-series
      - rssout

  Tv-Premiere:
    priority: 31
    interval: 3 hours
    preset:
      - TVseries_input
      - Tv-Premiere
      - Tv-series
      - rssout

  My_movies:
    priority: 40
    interval: 1 days
    preset:
      - movieENG_input 
      - My_movies
      - rssout

  Local_Movies:
    priority: 41
    interval: 1 days
    preset:
      - moviePT_input
      - Movie-Local
      - rssout

  Movies:
    priority: 45
    interval: 1 days
    preset:
      - movieENG_input 
      - movies
      - rssout

  K-lite:
    priority: 70
    interval: 7 days
    preset:
      - no_global
      - K-lite
    manual: yes

  emailfeed:
    priority: 100
    interval: 1 days
    preset:
      - no_global
      - emailfeed
edhaker13 commented 10 years ago

I think I found the problem, it worked in all my tests.

ghost commented 10 years ago

Working properly now. lol -- not show any error's Thank you so much, edhaker13. Make my day. =)

edhaker13 commented 10 years ago

No problem :). If anything sorry for taking this long to fix it.