Author = 'Vivek Sharma'
Program Description: ''' This program will take a website name as input and list out all the links on the given page. It will then go to each links on the listed pages and list out all the links on the respective pages. The program will end once it traverse all the links on the main page.'''
To run the program: Go to the program folder on the terminal and Install requirements.txt with below command
pip install -r requirements.txt
Run the program with the below command
python sitemap.py https://www.domain_name.com
Note:
python sitemap.py https://www.domain_name.com > log.txt