Feature: Add redis_to_sql.py script for moving finalized redis sets to sql

[Ruborcalor]

What's this?

• Updates models.py to include a DailyHours table. This table has columns (id, user_id, timestamp, study_time, rank). It's purpose is to store data currently being stored in redis sets once the redis sets go out of scope (they are no longer being updated)
• Adds redis_to_sql.py, a script for moving redis sets to the DailyHours table

usage: redis_to_sql.py [-h] [--date DATE] time

Migrate redis sets to mysql

positional arguments:
  time         The time of the redis set to migrate in format hh:mm:ss

optional arguments:
  -h, --help   show this help message and exit
  --date DATE  The date of the redis set to migrate in format Y-m-d. Default is today's date

Usage

• First we would want to run this script on all of the daily sets more than 24 hours old in order to clean up the old redis sets.
• Then we would automate the process going forwards by adding a cron job to run this script every hour of every day.

The crontab would be something like:

0 * * * * python redis_to_sql.py `date +%T`

Related Issues

• 27

What to review:

• Check that the redis set is being moved properly. A specific question I have is about the "in_session" redis sets. Should the script read data from the relevant "in_session" set and add it to the user's hours when inserting into the sql table? Or just ignore the "in_session" sets?

How has this been tested?

• Running the script in debug mode which prints out the rows it would add to the DailyHours table, but doesn't actually make any db changes.

[Zackhardtoname]

Great work! @Ruborcalor well I think we should delete all the in-session data since they also take up the memory but we don't need to transfer anything from in-session to the SQL since they are just pure temporary data.

[Zackhardtoname]

@Ruborcalor Great! Do you wanna squash and merge just so I don't accidentally steal your credit? I wish there's a way I can do it but assign you as the author, which would be convenient~

[Ruborcalor]

@Ruborcalor Great! Do you wanna squash and merge just so I don't accidentally steal your credit? I wish there's a way I can do it but assign you as the author, which would be convenient~

Sweet thanks yeah i'll squash and merge. Can you mark the PR as approved please?

[Zackhardtoname]

Sweet thanks yeah i'll squash and merge. Can you mark the PR as approved please?

Ah sorry about that!

[Ruborcalor]

Haha you're good just wanted to make it official :)