imthaghost / goclone

Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
https://goclone.io
MIT License
1.38k stars 294 forks source link
cloning crawler go golang website-cloner website-scraper

jedi

Copy websites to your computer! Goclone is a utility that allows you to download a website from the Internet to a local directory. Get html, css, js, images, and other files from the server to your computer. Goclone arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link as if you were viewing it online.


Official Website



Example

Table of Contents

πŸš€ Installation

Brew

# tap
brew tap imthaghost/goclone
# install tool
brew install goclone

Manual

# Go version >= 1.20
go install github.com/imthaghost/goclone/cmd/goclone@latest

Or

# go get :)
go get github.com/imthaghost/goclone
# change to project directory using your GOPATH
cd $GOPATH/src/github.com/imthaghost/goclone/cmd/goclone
# build and install application
go install

Examples

# goclone <url>
goclone https://configtree.co

Config

Usage

Usage:
  goclone <url> [flags]

Flags:
  -C, --cookie strings        Pre-set these cookies
  -h, --help                  help for goclone
  -o, --open                  Automatically open project in default browser
  -p, --proxy_string string   Proxy connection string. Support http and socks5 https://pkg.go.dev/github.com/gocolly/colly#Collector.SetProxy
  -s, --serve                 Serve the generated files using Echo.
  -P, --servePort int         Serve port number. (default 5000)
  -u, --user_agent string     Custom User Agent

Contributors

Contributions are welcome! Please see Contributing Guide for more details.

Gary Frederick
Tha Ghost

πŸ’»
Juan Mesaglio
Juan Mesaglio

πŸ’»
Ben Lafferty
Ben Lafferty

πŸ’»
Omar Sagoo
Omar Sagoo

πŸ’»