search

PaulJerimy / SecCertRoadmapHTML

Security Certification Roadmap HTML5/CSS3 version
Creative Commons Attribution Share Alike 4.0 International
439 stars 97 forks source link

Provide source data for the certs and metadata #104

Open reubano opened 8 months ago

reubano commented 8 months ago

It'd be great to have source data (csv, json, etc.) of all the info in this roadmap. That would make converting to a webapp much easier and also allow to filter certs by cost, category, difficultly, etc. I thought about scraping the HTML, but would like to avoid doing that if there is already a more structure data set available.

reubano commented 8 months ago

Regarding the proposed DB design, you definitely want a RDBMS (SQL). NoSQL is not suited for this type of data. I can assist with refining the schema if you'd like.

sinecurelife commented 2 days ago

Thank you reubano. I am still tinkering with this. I was hoping to store everything in JSONs so I don't need to pay for a DB, but we'll see what happens!

reubano commented 1 day ago

@sinecurelife sqlite is a free file based DB so no need to pay. Trust me, this is a highly relational data set so JSON is not an ideal storage format in this case. You can of course have JSON exports of select tables, but the native storage layer should be a DB.

sinecurelife commented 1 day ago

I'm planning deploying the web app to Azure or AWS (leaning towards Azure right now) so I thought I'd have to pay for their DBs. NoSQL is a lot cheaper on those.

However, I just found out I could just embed the SQLite inside my web app and not use the infrastructure provided DBs. That is, if the web app is only moderately popular. I'll have to build it so I can swap to a big boy MSSQL, MySQL, or PostgresDB later if the load gets too big.