search

ossdaiict / Intranet_Sync

Python Script to scrape and synchronize entire directories from Intranet
MIT License
0 stars 0 forks source link
asynchronous-programming beautifulsoup4 python3 scraping threading

readme

Intranet_Sync

Python Script to scrape and synchronize entire directories from Intranet - an Apache RedHat HTTP server

GitHub issues GitHub forks GitHub license

This script...

  1. Scrapes the remote directories (from DIR_URLS list)
  2. Compares with locally available files
  3. Asynchronously downloads missing files

Usage

Make sure you have Python 3 installed. Commands may vary for Windows environment.

1. Clone the project:

git clone https://github.com/meet59patel/Intranet_Sync.git

2. Install Dependencies:

Open terminal in Intranet_Sync directory.

pip install -r requirements.txt

3. Add links to the directories you want to synchronize:

Update DIR_URLS list inside main.py Also update DEST_PATH

4. Run:

python3 main.py

Development