Create Demo class for downloading, processing, parsing, deletion - Githubissues

JackWagner / stattrak

Counter-Strike 2 gameplay aggregator and stat collector

0 stars 0 forks source link

Create Demo class for downloading, processing, parsing, deletion #13

Closed JackWagner closed 10 months ago

JackWagner commented 10 months ago

BACKGROUND

Context: Once a new demo URL has been identified, it must be downloaded, parsed, and deleted.
Problem: We do not have any processing functions beyond the initial downloading
Solution: Create Demo class with all types of processing functions, finish downstream pipeline and test on EC2

STEPS:

[x] Download to EC2 staging area
[x] Write new class Demo
- [x] Move download function here
- [x] Process BZ2 function
- [x] Store important parsed data in DB function
- [x] Delete file function
[x] Deploy and test on EC2