Project: Asking Madden
Author(s): Elton Murillo
Creation Date: 11-03-2015
ABOUT
Asking Madden is a data aggregation project which scrapes NFL.com and ESPN.com (shhhh) for teams and player statistics. This data will be used for project-oden, data visualization and helping win millions of dollars.
DOCUMENTATION
-
COMPATIBILITY AND REQUIREMENTS
-
GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin15) or Linux elton-ThinkPad-X220 4.4.0-31-generic #50-Ubuntu SMP Wed Jul 13 00:07:12 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
-
Python 2.7.10
-
Beautiful Soup 4.4.0
-
HOW TO BUILD
-
Use bash to run the shell scripts.
-
pip install beautifulsoup4.
-
For documentation, please refer to section 3.
-
FILE(S)
-
get-teams-schedules.py
- Python script to aggregate all team schedule for season.
-
get-teams-standings.sh
- Shell script to aggregate all team standings for season.
-
get-teams-stats.py
- Python script to aggregate team stats for season.
-
parse-teams-schedule.py
- Python script to parse team schedules.
-
parse-teams-standings.py
- Python script to parse team standings.
-
get-player-careerstats.py
- Shell script to aggregate all player career stats for season.
-
get-player-combine.py
- Shell script to aggregate all player combine stats for season.
-
get-player-draft.py
- Shell script to aggregate all player draft data for season.
-
get-player-gamelogs.py
- Shell script to aggregate all player gamelogs for season.
-
get-player-gamesplits.py
- Shell script to aggregate all player gamesplits for season.
-
get-player-situationalstats.py
- Shell script to aggregate all player situational stats for season.
-
FILE DIRECTORY
-
/ - Root folder containing scripts to aggregate for now. ( Needs clean-up later )
-
target/ - Folder where output file(s) go.
CONTACT
- phone: (415) 312-0534
- e-mail: elton.murillo@yahoo.com
TODO
- Parse Player Stats
- Test if all files are converted to CSV correctly.
- Create database schema for application
Application Flow
- [home]
- [search player]
- [results]
- [player page]
- [search team]
- [results]
- [team page]
- [search season]
- [results]
- [season page]