search

ShoobyDoo / OPGG.py

An unofficial Python library for accessing OPGG data.
BSD 3-Clause "New" or "Revised" License
13 stars 5 forks source link

Investigate a potential migration of cache structure from sqlite3 to TinyDB (document-oriented database/nosql) #36

Closed ShoobyDoo closed 4 days ago

ShoobyDoo commented 3 months ago

I'm realizing as the project grows, it will get more and more tedious to add tables to sqlite. I chose sqlite for the performance over simply just storing the cache in a json file.

So I will need to either:

  1. Stop destructuring the individual properties into table columns and just do a verbatim json string dump into the tables (not ideal)
  2. Or, investigate an alternative method to store the data. Its ineffecient to destructure, get the data down to a manner fitting to be inserted and then store vs just storing the data in its original structure. TinyDB seems to still use .json files, but has some optimizations and querying built in.
ShoobyDoo commented 4 days ago

No longer required, will be closed by 2.0