search

yehonadav / learn_git

introduction to working with git & github, contributors will be able to create programs, make fixes, and commit messages
Apache License 2.0
2 stars 1 forks source link

yehonadav #2

Open yehonadav opened 5 years ago

yehonadav commented 5 years ago

creating 3 programs

yehonadav commented 5 years ago

my branch is ready for review

yehonadav commented 5 years ago

but don't delete it after review please

yehonadav commented 5 years ago

i need a python program that uses the requests module to crawl html data

yehonadav commented 5 years ago

my program asks for words, and url addresses and counts word occurence for each url my file structure:

git_learn
       |
    yehonadav
            |
          crawler
                |-README.md  # how to file
                |-requirements.txt # external dependencies file
                |-__init__.py # main program function file
                |-__main__.py # the file running the main program
                |-menu.py # file holding a string parameter of the start menu of the program
                |-count_url_words.py # function with input: urls: dict, words: list, updates each url with words and number of occurences
                |-get_urls.py # function to ask user url addresses and return a dictionary
                |-get_words.py # function to ask words and return a list of words
                |-show_counters.py # function to show each word occurences for each url

https://github.com/yehonadav/learn_git/blob/yehonadav/images/crawler.JPG