emurillo510 / asking-madden-data

Asking Madden is a data aggregation project which scrapes NFL.com and ESPN.com (shhhh) for teams and player statistics. This data will be used for project-oden, data visualization and helping win millions of dollars.
1 stars 0 forks source link

Project: Asking Madden

Author(s): Elton Murillo

Creation Date: 11-03-2015

ABOUT

Asking Madden is a data aggregation project which scrapes NFL.com and ESPN.com (shhhh) for teams and player statistics. This data will be used for project-oden, data visualization and helping win millions of dollars.

DOCUMENTATION

  1. COMPATIBILITY AND REQUIREMENTS

  2. GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin15) or Linux elton-ThinkPad-X220 4.4.0-31-generic #50-Ubuntu SMP Wed Jul 13 00:07:12 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

  3. Python 2.7.10

  4. Beautiful Soup 4.4.0

  5. HOW TO BUILD

  6. Use bash to run the shell scripts.

  7. pip install beautifulsoup4.

  8. For documentation, please refer to section 3.

  9. FILE(S)

  10. get-teams-schedules.py

    • Python script to aggregate all team schedule for season.
  11. get-teams-standings.sh

    • Shell script to aggregate all team standings for season.
  12. get-teams-stats.py

    • Python script to aggregate team stats for season.
  13. parse-teams-schedule.py

    • Python script to parse team schedules.
  14. parse-teams-standings.py

    • Python script to parse team standings.
  15. get-player-careerstats.py

    • Shell script to aggregate all player career stats for season.
  16. get-player-combine.py

    • Shell script to aggregate all player combine stats for season.
  17. get-player-draft.py

    • Shell script to aggregate all player draft data for season.
  18. get-player-gamelogs.py

    • Shell script to aggregate all player gamelogs for season.
  19. get-player-gamesplits.py

    • Shell script to aggregate all player gamesplits for season.
  20. get-player-situationalstats.py

    • Shell script to aggregate all player situational stats for season.
  21. FILE DIRECTORY

  22. / - Root folder containing scripts to aggregate for now. ( Needs clean-up later )

  23. target/ - Folder where output file(s) go.

CONTACT

  1. phone: (415) 312-0534
  2. e-mail: elton.murillo@yahoo.com

TODO

Application Flow