Closed AndhikaWB closed 11 months ago
Checked it out, everything looks good!
@ArshKA the resuming part is quite important, when debugging what's wrong with industry/skill name, I opened the db during sleep period and stopped fixing/modifying the db when it resume.
I noticed that you removed the search_retriever.py
resume indicator on the latest commit, it may be useful to prevent conflict write since I'm not sure how SQLite handle concurrent writing.
Just re-added it
industries
table andskills
table. Though it seems that there might be some minor cases where the value will still be null. In that case, I suspect the length (list) of industry id/skill abbrev is not the same as the industry/skill name. Script only, no change on database (should be easily fixable).create_db.py
script (no change on database). Revert it back in case I'm wrong.BROWSER
variable). It kinda make sense to use Edge since it comes preinstalled on most Windows OS (and since I don't have Chrome installed because I use Firefox). There may be a way to auto-detect browser though, we should implement that in the future. The current script will hang if we don't have Chrome/Edge installed, with no error output (I blame Selenium for that).logins.csv
when commiting (via.gitignore
), addedlogins.csv.template
insteadI also wrote the revisions in
create_db.py
anddatabase_scripts.py
sojob_skills
andjob_industries
tables will have a new column containing the full industry/skill name, though I left them commented since I'm not sure if that's what you want.