dipu-bd / lightnovel-crawler

Generate and download e-books from online sources.
https://pypi.org/project/lightnovel-crawler/
GNU General Public License v3.0
1.35k stars 263 forks source link

https://www.panda-novel.com #1343

Open Sabruness opened 2 years ago

Sabruness commented 2 years ago
Nabeelshar commented 2 years ago

Content Manga Yes Has Cloudflare Yes Machine Translation No

budikesuma commented 1 year ago

@dipu-bd , @idMysteries ,

Hello Devs,

It has a lot of privileged chapters from clean qidian International sources. This should be the main source for fans who don't have coins to exchange for VIP chapters. Has protection like aqua manga (https://aquamanga.com/), should be easy to scrape like that site...

Test novel link:

https://www.panda-novel.com/details/the-author-s-pov(KN)-1086

idMysteries commented 1 year ago

Seems like I can do it O_o

idMysteries commented 1 year ago

This site uses encryption of the content of the novel

idMysteries commented 1 year ago

image image Idk how to copy this hmmmmmmmmmm

idMysteries commented 1 year ago

image

Sub2Assassin commented 1 year ago

If it is possible then it would be great...I use this site too it has alot of privilege chps and also new novels that isn't found anywhere else.

idMysteries commented 1 year ago

@dipu-bd https://github.com/IReaderorg/IReader-extensions/blob/d496f732861e1f694470298a1716cfbc51fd376f/sources/en/pandanovel/main/src/ireader/pandanovel/PandaNovel.kt

Somehow this code apparently works. Although in theory it shouldn't, because the chapters are loaded via javascript O_o

Sub2Assassin commented 1 year ago

So what's the problem? Lol are we adding the site in list or?

idMysteries commented 1 year ago

So what's the problem? Lol are we adding the site in list or?

image image

idMysteries commented 1 year ago

изображение

idMysteries commented 1 year ago

@dipu-bd fuuuuuu import android.webkit.WebView

    override suspend fun getContentRequest(
        chapter: ChapterInfo,
        commands: List<Command<*>>
    ): Document {

        return deps.httpClients.browser.fetch(
            chapter.key,
            selector = "#novelArticle1",
            timeout = 50000
        ).responseBody.asJsoup()
    }
idMysteries commented 1 year ago

Android can use its internal browser for such things. Damn it. Why can't we do this on python? T_T .NET has a "built-in" browser, if memory serves me right. It seems to be also called WebView

idMysteries commented 1 year ago

@dipu-bd Qt has browser O_O https://github.com/7ws/webkitcrawler Maybe we can use something like this?????????? PyQt5 webview + lightnovel-crawler = <3 ??????

Or parse a string from the Githubissues.

  • Githubissues is a development platform for aggregating issues.