everywall / ladder

Selfhosted alternative to 12ft.io. and 1ft.io bypass paywalls with a proxy ladder and remove CORS headers from any URL
GNU General Public License v3.0
4.29k stars 169 forks source link

Idea: break rulesets out into subdirectories and separate files #32

Closed deoxykev closed 7 months ago

deoxykev commented 7 months ago

I think the list of rulset modifications will grow very large over time. Just check out what happened to magnolia1234's bypass-paywalls-firefox-clean ruleset. There are over 1000 individual domains.

A single file would be difficult to maintain.

I propose the ability to fetch rulesets from an open directory, so that they could be organized better.

For example:

rulesets
├── de
│  └── tagesspiegel-de.yaml
├── it
└── us
   └── nytimes.yaml
mms-gianni commented 7 months ago

sure.

We need to detect if it is a URL, a file, or a directory.

And then, in the case of a directory, concatenate the files to the ruleset.

mms-gianni commented 7 months ago

And again! Awesome work. I'm getting a bit jealous. Your coding style is much cleaner than mine 😄 Every function has a short description.

I think we can start splitting the rulesfile. Do we need a separate repository?

deoxykev commented 7 months ago

Yes, I do think a separate repository would be good, to ensure the survivability of this project (keep the lawyers at bay). I've split them out in a PR https://github.com/everywall/ladder/pull/41, but we could put it in a new repo.