search

riderkick / FMD

Forked from https://sf.net/p/fmd/
GNU General Public License v2.0
717 stars 212 forks source link

MangaDex not showing chapters. #1103

Open Wolfpup67 opened 6 years ago

Wolfpup67 commented 6 years ago

After commit 239cf3b MangaDex is no longer displaying the chapters or cover. ALL manga are showing 0 chapters. While when checking the site the cover and chapters are present.

mangadex_nochapters

kmvi commented 6 years ago

try to download MangaDex.lua manually and replace it in your installation

Wolfpup67 commented 6 years ago

@kmvi after replacing the file like you suggested i still have the same issue, plus ALL the of the favorites that i have for mangadex are now showing n/a when i try to view info from the favorites list.

kmvi commented 6 years ago

It's weird. Is there anything interesting in log? Also you can try to delete config\luamodules.json and run FMD. All modules will be re-downloaded.

Wolfpup67 commented 6 years ago

I tried that and there is nothing in the log except where the modules are loaded.

arbiter9605 commented 6 years ago

I have had same thing with mine been that way last 3 days. Some mangas i get info like name, authors, etc where as others i just see N/A.

I did same thing you asked Wolfpup67 to do, with same end results as his. I have also test running by proxying program through my dedi in another country and my laptop.

Tmp341 commented 6 years ago

Check if your ip banned. ssss

According to this, ip gets banned automatically.

arbiter9605 commented 6 years ago

If i was ip banned then I don't think i could load page up and read manga, plus as i posted i used my dedi which is in completely diff land mass then me and still get same results.

Tmp341 commented 6 years ago

Your lua might be corrupted. Try fresh install while backing up these:

You can backup others but these should work for you.

Wolfpup67 commented 6 years ago

@Tmp341 I'm not banned as i limit my mangadex connections and have even tried what you suggested but i am still haveing the same issue.

redsentinel1987 commented 6 years ago

@Wolfpup67 Just downgrade your FMD version like i did, it works normal again for me, and uncheck the "auto check for latest version" right now i'm using version 0.9.137.0

ratbunuts commented 6 years ago

mine's like that now too after the update of the mangadex.lua. it was working fine yesterday and after the update it stop working. now I cant seems to make it work again

kmvi commented 6 years ago

i don't understand how it possible. mangadex works absolutely normal. i just downloaded latest release, updated all modules and everything works fine. untitled

make sure you are using this module version MangaDex.zip

ratbunuts commented 6 years ago

I just downloaded that zip file and still the same. I dont really know whats wrong. I was just downloading all the chapters of Grand Blue and it stop half way. My ip might be banned or something. I can access mangadex though

Thrieze commented 6 years ago

I have the same issue somehow.

Tmp341 commented 6 years ago

No problem here either. untitled-1

Wolfpup67 commented 6 years ago

I have tried everything including doing a complete fresh install and after the the fresh install i can not even get the mangadex data base to update. BTW im running the 64 bit version.

Tmp341 commented 6 years ago

Have you tried via vpn?

Thrieze commented 6 years ago

Ok so I finally got my Internet back, I was Tethered via 4g (snow storm took out Internet) and once i got my normal Internet back I could download chapters like normal again. So somehow I think your banned from downloading but can read the site still? Im honestly not sure. Cause I could also browse the website and read but not load chapters in FMD.

Tmp341 commented 6 years ago

Website might be detecting what you're using, like browser or other software. Then blocking your requests until you open your browser.

Wolfpup67 commented 6 years ago

I have Chrome open and on the site when I'm using FMD.

jefklak commented 6 years ago

Same issue, chrome open with website open, fresh download of FMD version 0.9.152.0 using last version of mangadex downloadable above. mangadex.db is 10576 kb,

0xh3LL0 commented 6 years ago

UPDATE: we can download the manga, as long the manga chapter is present on managdex, make sure to check the chapter before download

same issue here, fresh install fmd version 0.9.152 all chapter is 0 mangadex

here is the log

=== Log Session Started at 16/03/2018 10:12:28 by Free Manga Downloader === 10:12:28:093 INFO: "Free Manga Downloader" started with [PID:460] [HANDLE:4294967295] 10:12:28:093 STRINGS: Application info Application : Free Manga Downloader Version : 0.9.152.0 Product Version : Win32 Debug Host Machine : Windows XP FPC Version : 3.0.4 LCL Version : 1.8.0.6 WidgetSet : Win32/Win64 Target CPU-OS : i386-Win32 Build Time : 2018/02/28 06:49:28 Path : D:\DL+Torrent\FMD\fmd.exe Process ID : 460 MainThread ID : 4012 10:12:28:484 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\AnimExtremist.lua 10:12:28:515 VALUE: Loaded modules from AnimExtremist.lua = AnimExtremist 10:12:28:515 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\CentralDeMangas.lua 10:12:28:515 VALUE: Loaded modules from CentralDeMangas.lua = CentralDeMangas 10:12:28:515 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\ComicVn.lua 10:12:28:515 VALUE: Loaded modules from ComicVn.lua = ComicVn 10:12:28:515 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\DesuMe.lua 10:12:28:515 VALUE: Loaded modules from DesuMe.lua = DesuMe 10:12:28:515 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\DynastyScans.lua 10:12:28:515 VALUE: Loaded modules from DynastyScans.lua = DynastyScans 10:12:28:515 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\EGScans.lua 10:12:28:515 VALUE: Loaded modules from EGScans.lua = EGScans 10:12:28:515 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\FoOlSlide.lua 10:12:28:531 VALUE: Loaded modules from FoOlSlide.lua = PowerManga, Shoujosense, GoManga, OneTimeScans, SenseScans, Jaiminisbox, KireiCake, HelveticaScans, WhiteoutScans, DokiFansubs, AtelierDuNoir, ChampionScans, WorldThree, S2Scans, HotChocolateScans, LetItGoScans, TripleSevenScan, SeaOtterScans, AntisenseScans, TheCatScans, DeathTollScans, MangaichiScan, ForgottenScans, Riceballicious, PhoenixSerenade, VortexScans, RoseliaScanlations, SaikoScans, Yuri-ism, SilentSkyScans, HatigarmScans, BunnysScans, CanisMajorScans, HoshikuzuuScans, YaoiIsLife, FujoshiBitches, TwistedHelScans, TapTrans, DangoOnlineNoFansub, DejameProbar, HoshinoFansub, MenudoFansub, NeoProjectScan, Pzykosis666HFansub, SantosScan, SeinagiFansub, SeinagiAdultoFansub, SolitarioNoFansub, RavensScans, KirishimaFansub, NoraNoFansub, YamiTenshiNoFansub, XAnimeSeduccion, JokerFansub, PatyScans, IdkScans, Nightow, TrueColorsScan, MangajinNoFansub 10:12:28:531 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\FunManga.lua 10:12:28:531 VALUE: Loaded modules from FunManga.lua = FunManga, MangaDoom 10:12:28:531 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\HeavenManga.lua 10:12:28:531 VALUE: Loaded modules from HeavenManga.lua = HeavenManga 10:12:28:531 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\HentaiHere.lua 10:12:28:531 VALUE: Loaded modules from HentaiHere.lua = HentaiHere 10:12:28:531 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\Imgur.lua 10:12:28:531 VALUE: Loaded modules from Imgur.lua = Imgur 10:12:28:531 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\jsunpack.lua 10:12:28:531 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\LeitorNet.lua 10:12:28:531 VALUE: Loaded modules from LeitorNet.lua = LeitorNet 10:12:28:531 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\LHTranslation.lua 10:12:28:546 VALUE: Loaded modules from LHTranslation.lua = LHTranslation 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\lzstring.lua 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaDex.lua 10:12:28:546 VALUE: Loaded modules from MangaDex.lua = MangaDex 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaHubIO.lua 10:12:28:546 VALUE: Loaded modules from MangaHubIO.lua = MangaHubIO, MangaReaderSite, MangaFoxFun, MangaKakalotFun 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\Mangakakalot.lua 10:12:28:546 VALUE: Loaded modules from Mangakakalot.lua = Mangakakalot, Manganelo, Mangasupa, MangaFoxCom 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaKu.lua 10:12:28:546 VALUE: Loaded modules from MangaKu.lua = MangaKu 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaLib.lua 10:12:28:546 VALUE: Loaded modules from MangaLib.lua = MangaLib 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaOku.lua 10:12:28:546 VALUE: Loaded modules from MangaOku.lua = MangaOku, Turkcraft 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaOnlineBiz.lua 10:12:28:546 VALUE: Loaded modules from MangaOnlineBiz.lua = MangaOnlineBiz 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaSh.lua 10:12:28:546 VALUE: Loaded modules from MangaSh.lua = MangaSh 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaShiro.lua 10:12:28:546 VALUE: Loaded modules from MangaShiro.lua = MangaShiro, Subapics, MangaKita, Mangavy, KomikStation, MangaKid 10:12:28:546 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaStream.lua 10:12:28:546 VALUE: Loaded modules from MangaStream.lua = MangaStream 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MangaTown.lua 10:12:28:562 VALUE: Loaded modules from MangaTown.lua = MangaTown 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\ManHuaGui.lua 10:12:28:562 VALUE: Loaded modules from ManHuaGui.lua = ManHuaGui 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\ManHuaTai.lua 10:12:28:562 VALUE: Loaded modules from ManHuaTai.lua = ManHuaTai 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\ManhwaCo.lua 10:12:28:562 VALUE: Loaded modules from ManhwaCo.lua = ManhwaCo 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\MyMangaIO.lua 10:12:28:562 VALUE: Loaded modules from MyMangaIO.lua = MyMangaIO 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\myReaderMangaCMS.lua 10:12:28:562 VALUE: Loaded modules from myReaderMangaCMS.lua = MangaForest, MangaDoor, Komikid, MangaDesu, MangaID, RawMangaUpdate, MangaRawOnline, MangaDenizi, ManhuaTr, MangaVadisi, FallenAngelsScans, ChibiManga, DarkSkyScan, NozominoFansub 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\NeuManga.lua 10:12:28:562 VALUE: Loaded modules from NeuManga.lua = NeuManga 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\NHentai.lua 10:12:28:562 VALUE: Loaded modules from NHentai.lua = NHentai 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\Pururin.lua 10:12:28:562 VALUE: Loaded modules from Pururin.lua = Pururin 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\rawdevart.lua 10:12:28:562 VALUE: Loaded modules from rawdevart.lua = Rawdevart, TrashScanlations, ZeroScans 10:12:28:562 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\ReadMangaEU.lua 10:12:28:578 VALUE: Loaded modules from ReadMangaEU.lua = ReadMangaEU 10:12:28:578 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\Shakai.lua 10:12:28:578 VALUE: Loaded modules from Shakai.lua = Shakai 10:12:28:578 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\SKSubs.lua 10:12:28:578 VALUE: Loaded modules from SKSubs.lua = SKSubs 10:12:28:578 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\SoManga.lua 10:12:28:578 VALUE: Loaded modules from SoManga.lua = SoManga 10:12:28:578 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\TenManga.lua 10:12:28:578 VALUE: Loaded modules from TenManga.lua = TenManga 10:12:28:578 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\VnSharing.lua 10:12:28:578 VALUE: Loaded modules from VnSharing.lua = VnSharing 10:12:28:578 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\WieManga.lua 10:12:28:578 VALUE: Loaded modules from WieManga.lua = WieManga, MangaRussia 10:12:28:578 VALUE: Load lua website module = D:\DL+Torrent\FMD\lua\modules\WPManga.lua 10:12:28:578 VALUE: Loaded modules from WPManga.lua = MangaBoom, Authrone, EyeOnManga, MangaDeep, Manga99, MangaOnlineToday, ReadHentaiManga, HentaiRead, MangaCow, MerakiScans 10:18:10:312 INFO: TMainForm.FormClose 10:18:11:296 INFO: TMainForm.CloseNow, disabling all timer 10:18:11:296 INFO: TMainForm.CloseNow, backup downloads 10:18:11:296 INFO: TMainForm.CloseNow, backup favorites 10:18:11:296 INFO: TMainForm.CloseNow, backup all data to file 10:18:11:375 INFO: TMainForm.CloseNow, close other forms 10:18:11:375 INFO: TMainForm.CloseNow, stop ipc server 10:18:11:390 INFO: TMainForm.FormDestroy, freeing all objects 10:18:11:968 INFO: "Free Manga Downloader" exit normally [PID:460] [HANDLE:4294967295]

Tmp341 commented 6 years ago

@0xh3LL0 Try data removal. Move your mangadex.db from \data\ folder to somewhere else.

0xh3LL0 commented 6 years ago

UPDATE: we can download the manga, as long the manga chapter is present on managdex, make sure to check the chapter before download

i did, remove mangadex.db from \data\, and when i open FMD it ask me to download the database, i click yes, but then it just same, there is manga list, but all chapter still 0, even after i restart FMD it still 0...

kmvi commented 6 years ago

Also try to change user agent. Options -> Websites -> Advanced tab, select MangaDex in list, check Enabled, and set UserAgent setting to some value. For example, Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.186 Safari/537.36

ratbunuts commented 6 years ago

It will come back after a week. Mine just got back since yesterday. I had the same problem as you

Tmp341 commented 6 years ago

User agent can be detected by writing detect user agent to Google.

jefklak commented 6 years ago

UPDATE: Nevermind, it stopped working and cannot get it to work anymore. :(

0xh3LL0 commented 6 years ago

UPDATE: we can download the manga, as long the manga chapter is present on managdex, make sure to check the chapter before download

after did what @kmvi suggested, chapter for some manga are visible, but still not for all... mangadex3

Tmp341 commented 6 years ago

@0xh3LL0 Which manga isn't visible for example?

0xh3LL0 commented 6 years ago

UPDATE: we can download the manga, as long the manga chapter is present on managdex, make sure to check the chapter before download

@Tmp341 how about Free! https://mangadex.org/manga/11084

mangadex

Tmp341 commented 6 years ago

That manga has no chapters. Checked via browser.

0xh3LL0 commented 6 years ago

whoops, looks like you're right, i didnt check the manga with browser before, because mainly i use mangahere, and hardly see any problem with it. now, i checked the manga with browser, choose manga that the chapter is present, and then use FMD, and it works. guess i just lucky then, after i use the setting you suggested and click on random manga, and indeed it works (tried 5 manga in total), so i think that your settings really works, but then i remove the useragent setting, and it still works, for the manga that the chapter is present of course...

so i guess the problem is appear that the manga doesnt have chapter on mangadex, i suppose...

Tmp341 commented 6 years ago

User agent is an optional setting, in case of a problem occurs. But not a necessity, if it isn't changing anything.

jefklak commented 6 years ago

Doesn't work for me image

jefklak commented 6 years ago

Additionally: downloading all manga lists from server at once: image image

probably not related but annoying nontheless

0xh3LL0 commented 6 years ago

@jefklak Freezing run just fine on me, tried download 2chapters, and its done...

mangadex4

Tmp341 commented 6 years ago

@jefklak Failed to exctract happens when your downloaded database is corrupted. Usually because, you couldn't connect to SF servers normally. Try downloding manually from here when that happens. Or wait for SF.

Also, check if your ip is banned or not. If not banned, try to rebuilding your mangadex database, by deleting (or moving somewhere else) it. If that doesn't solve, try to fresh install.

But, like @0xh3LL0 I can connect mangadex and download normally.

jefklak commented 6 years ago

@Tmp341

  1. I don't think I am banned, as I can open the website perfectly fine: image

  2. That secondary error indeed happens when I already have a DB, so it is not related to the stuff not loading. Downloaded it from SF anyway and put it in the data folder

  3. Started up FMD, this is what it first looks like: image

  4. after trying to open freezing: image

New install, no new install, new install on different laptop, all the same issue

jefklak commented 6 years ago

All right people, just to be sure I restarted the router in the hope of getting a new IP (you never knew) ... and that seems to have done the trick: HTTP_X_REAL_IP in HTPP header changed and TAADAA:

image

So my question now is, to avoid IP bans, what to do as a setup?

jefklak commented 6 years ago

Are these settings ok? image

jefklak commented 6 years ago

So after doing "update manga list", mangadex is unconnectable again. Somewhere halfway the update I could still retrieve data, towars 3/4th of the update it suddenly stopped and all favorites turned red and manga info screen went empty without chapters.

Guess no update functionality for mangadex anymore without IP ban? Does the "download" option give you the latest manga in blue too?

Tmp341 commented 6 years ago

sssss

@jefklak Yours are my default settings. And I'm also using these for mangadex. You can set these settings here: Options -> Websites -> Advanced -> Mangadex

jefklak commented 6 years ago

All right, copied your settings over, thanks a lot!!

As for the "update manga list" option, is that limited with these settings too or are they only for downloads?

Tmp341 commented 6 years ago

These are site specific settings. I think UpdateListNumberOfThread setting effects Update List.

jefklak commented 6 years ago

Have the setting, blocked again after doing the update

Wolfpup67 commented 6 years ago

Here is a copy of my fmd install that i run in portable mode. fmd_mangadex_issue

kmvi commented 6 years ago

@Wolfpup67 I used your version and the chapters are shown:

untitled

Download also completed successfully:

2

Ok, let's see what mangadex sends you:

Wolfpup67 commented 6 years ago

ok here is the log. fmd.log

I looked at the log and it is saying that i'm banned, BUT when i access the site from Chrome, FF, Opera, or IE i still have full access to the site. I wonder why it is blocking FMD but not the others. I have made changes so that im useing the limiting settings and browser id. EDIT : After looking at the log again it would seam that for some reason on my system the program is not accepting cookies and thus is being denied access but is not actually banned.

Tmp341 commented 6 years ago

Access denied | mangadex.org used Cloudflare to restrict access

I think your IP marked by cloudflare.