ParanoidFFD

Undetectable FanFiction Downloader with Parallel Downloading

The program I was using to download my fanfics broke when fanfiction.net implemented cloudflare which blocks automated downloader scripts.

So I made my own "undetectable" downloader, ParanoidFFD.

Dependency

Chromium appimage and chromedriver for ParanoidFFD in the same directory as ParanoidFFD (Linux only)

or

chromedriver in the same directory as ParanoidFFD and system install of Google Chrome / Chromium in the default install path.

Depending on your system, using system installed chrome and chromedriver might have faster download speeds.
Python3 (3.6 or higher)
Python selenium,joblib,re,random,zipfile,base64,time,psutil modules
You can delete every file/folder in this repo once you've compiled ParanoidFFD - ParanoidFFD doesn't require any files/folders in this repo to run. You need only chromedriver (and appimage).

Build dependency

C compiler

Python3 dev package (with Python.h header)

Usage

$ ./ParanoidFFD --help

 ________________________________________________________________________________________ 

 Usage    : ParanoidFFD <options>                                                         

 Options  :                                                                               
   -u <fanfiction url> : download from <fanfiction url>                                   
   -f <FORMAT>         : save fanfiction as <FORMAT>                                      
                         currently supported format : txt, epub                           
                         default : txt                                                    
   -o <FILE_NAME>      : save fanfiction as <FILE_NAME>.<FORMAT>                          
                         default : fanfiction_title.<FORMAT>                              
   -t <n>              : numder of parallel download threads, use a positive integer      
                         default : 2                                                      
                         WARNING; high threadcount use for long fics may trigger captchas 
   --version           : show ParanoidFFD version                                         
   --check-update      : check for new updates                                            
   -h , --help         : show this page                                                   

 Examples :                                                                               
   ParanoidFFD -u "my/fan/fiction/url"                                                    
   ParanoidFFD -f epub -t 4 -o "my fanfiction save" -u "my/fan/fiction/url"               
   ParanoidFFD --check-update                                                             
 ________________________________________________________________________________________

Using ParanoidFFD may get you (temporarily) banned. Use with caution, especially with parallel downloading. High parallel download threadcount is okay to use for short periods of time, but not for long periods of time. For example, 6 threads is probably okay for a 30 chapter fic, but downloading a 90 chapter fic with 4 threads will probably lead to a captcha and ParanoidFFD failing to download.

Installation (Linux)

git clone https://github.com/Paranoid-Dev/ParanoidFFD.git
cd ParanoidFFD
pip3 install selenium joblib psutil

# do these to use "Chromium appimage and chromedriver for ParanoidFFD". 
# If you choose not to do this, you have to manually download chromedriver from https://chromedriver.chromium.org/downloads
wget https://github.com/Paranoid-Dev/ParanoidFFD/releases/download/v1.3.0.0/ParanoidFFD_chrome.zip
unzip ParanoidFFD_chrome.zip
rm ParanoidFFD_chrome.zip

# change python version and Python.h include path to match your system
gcc parallel-downloader.c -o ParanoidFFD -I/usr/include/python3.9 -lpython3.9

How to find Python.h include path and Python version

$ sudo find / -iname "Python.h"
/usr/include/python3.9/Python.h
/usr/include/python2.7/Python.h

So in my case, my Python version is 3.9, and the Python.h include path is /usr/include/python3.9

WARNING; if you have multiple versions of Python 3 installed, you must compile with your system's default version or it will fail to import

Installation (Windows)

Installation for Windows should be the same as for Linux, except you have to use system installed Google Chrome / Chromium and download Chromedriver yourself.

And in parallel-downloader.c, you have to change ./chromedriver to .\chromedriver.exe (I'll fix this in the coming updates)

I'm working on building a single exe file, but for now, you'll have to compile it yourselves.

Installation (MacOS)

Installation for MacOS should be the same as for Linux, except you have to use system installed Google Chrome / Chromium and download Chromedriver yourself.

For "brew installed Python" users

brew install python@3.9
pip3 install selenium joblib psutil

# for apple silicon
clang parallel-downloader.c -o ParanoidFFD -I/opt/homebrew/Frameworks/Python.framework/Versions/3.9/include/python3.9 -L/opt/homebrew/Frameworks/Python.framework/Versions/3.9/lib -lpython3.9

# for intel
clang parallel-downloader.c -o ParanoidFFD -I/usr/local/homebrew/Frameworks/Python.framework/Versions/3.9/include/python3.9 -L/usr/local/homebrew/Frameworks/Python.framework/Versions/3.9/lib -lpython3.9

For "non-brew installed Python" users

sudo find / -iname "Python.h" : Find Python.h include path and Python version

Change Python version and Python.h include path, and Python library path to match your system and apply to above.

Discord

discord.gg/vuyt6HSSFb Get the Paranoid Programmer role to join the (yet small) ParanoidFFD community

Paranoid-Dev / ParanoidFFD

readme