search

atlas-engineer / nyxt

Nyxt - the hacker's browser.
https://nyxt-browser.com/
9.77k stars 409 forks source link

Leverage cl-https-everywhere for force-https-mode #1303

Open Ambrevar opened 3 years ago

Ambrevar commented 3 years ago

Not all URLs should be rewritten to HTTPS, and cl-https-everywhere can help us with that: https://github.com/ruricolist/cl-https-everywhere

hendursaga commented 2 years ago

Isn't the EFF retiring HTTPS Everywhere? We might want to look into DuckDuckGo's Smarter Encryption extension, or at least its list.

Ambrevar commented 2 years ago

Right, I found the announcement: https://www.eff.org/deeplinks/2021/04/https-everywhere-now-uses-duckduckgos-smarter-encryption

hendursaga commented 1 year ago

Would the list being licensed CC BY-NC-SA 4.0 be a problem? Perhaps by not bundling but allowing the option to download it??

hendursaga commented 1 year ago

Obviously we'd want to have an option, perhaps even not the default, since the compressed file is 1/4 gigabyte..

hendursaga commented 1 year ago

So the file literally is just a bazillion hostnames, one line each. I was thinking some sort of succinct data structure, like they use for dictionary lookup? Or do we just want to throw it into an SQLite database?

Ambrevar commented 1 year ago

If it's this big, SQLite might be a good option.

hendursaga commented 1 year ago

What SQL / SQLite library should we use? cl-sqlite, perhaps?

hendursaga commented 1 year ago

And perhaps some query generator library like sxql??