search

learn-awesome / mobile-app

MIT License
1 stars 3 forks source link

Import the dataset JSON and load into memory to show list views #2

Closed teampolyglot closed 4 years ago

teampolyglot commented 4 years ago

The JSON will be periodically updated here: https://learnawesome-export.s3.us-east-2.amazonaws.com/dataset.json

The Job that generates this JSON is here: https://github.com/learn-awesome/learn/blob/master/lib/tasks/export.rake

teampolyglot commented 4 years ago

The domain model is basically this: image

However, the exported JSON hides the abstraction of idea_sets. This will have to be solved when we implement "Related Items" feature in the app.

teampolyglot commented 4 years ago

Right now, the JSON is small enough (10 MB) that it can be loaded in RAM. Eventually, we will have to store it in database with indexing for good performance. This can be taken up as an enhancement much later.

nileshtrivedi commented 4 years ago

This is fixed in #14 by @cyber-venom003. Closing.