Write Python script to insert pbp data into database

albertlyu / ncaab-pbp

A Python project for scraping NCAA men's basketball play-by-play data

MIT License

3 stars 0 forks source link

Write Python script to insert pbp data into database #2

Closed albertlyu closed 10 years ago

albertlyu commented 10 years ago

Work this issue after #1 is completed. Currently, the Python script writes PBP data to CSV. Write a new script that parses the JSON (from disk or from the web) and writes data into a SQL database. Explore Python drivers for open source RDBMS options like SQLite, MySQL and PostgreSQL, and decide which path to take. One main requirement right now is some upsert / merge process to update records that has a good Python driver. Or at least a good workaround.

albertlyu commented 10 years ago

Went with sqlite3 because it comes out of the box with Rails. Postgres in the future possibly. Resolved via https://github.com/albertlyu/ncaab-pbp/commit/0174b6f400221fdcbec9f05068ac682d76390f63