search

d43m0nhLInt3r / socialblocklists

Blocklists to block the communication to social networking sites and privacy harming services
380 stars 63 forks source link

PFblockerng compatible #16

Closed chromecapone closed 3 years ago

chromecapone commented 4 years ago

Can you make the snapchat and tiktok lists in a format compatible with pfblockerng? I have pfblockerng pulling your lists but its having hard time reading them. I THINK its because of the leading IP address and the expression at the bottom part of the tiktok file. I THINK pfblockerng likes a simple list of hosts one per line...but apparently it CAN read different formats...but for whatever reason, its having a hard time reading this format.

d43m0nhLInt3r commented 3 years ago

I will think about it but I dont promise anything. Sorry for the delay

d43m0nhLInt3r commented 3 years ago

Do you want any specific blocklist? I would port it and would make it avaiable in a new folder for pfblockerng

chromecapone commented 3 years ago

I was mainly interested in the tiktok one... thanks! That would be great!

On Wed, Aug 26, 2020 at 4:54 PM d43m0nhLInt3r notifications@github.com wrote:

Do you want any specific blocklist? I would port it and would make it avaiable in a new folder for pfblockerng

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/d43m0nhLInt3r/socialblocklists/issues/16#issuecomment-681118308, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYAJJDHTIPZNGNQSUELSCVZABANCNFSM4OFGLBAA .

ghost commented 3 years ago

These lists work fine with pfblockerng, you must be doing something wrong if it's not. Have you done a force reload? Are the lists format set to auto?

chromecapone commented 3 years ago

Yeah, you could be right. Let me give it another try and I'll get back to you! Thanks for your help

On Wed., Aug. 26, 2020, 5:10 p.m. gregf, notifications@github.com wrote:

These lists work fine with pfblockerng, you must be doing something wrong if it's not. Have you done a force reload? Are the lists format set to auto?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/d43m0nhLInt3r/socialblocklists/issues/16#issuecomment-681125645, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYBBRHDFKYSZNILUK6TSCV23RANCNFSM4OFGLBAA .

chromecapone commented 3 years ago

I added the feed again...and it downloads just fine (last time it wouldn't process the file), but now it does.

However, I can still access tiktok...just by typing it into chrome.

On Wed, Aug 26, 2020 at 5:16 PM Anthony Capone capone@cap1.net wrote:

Yeah, you could be right. Let me give it another try and I'll get back to you! Thanks for your help

On Wed., Aug. 26, 2020, 5:10 p.m. gregf, notifications@github.com wrote:

These lists work fine with pfblockerng, you must be doing something wrong if it's not. Have you done a force reload? Are the lists format set to auto?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/d43m0nhLInt3r/socialblocklists/issues/16#issuecomment-681125645, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYBBRHDFKYSZNILUK6TSCV23RANCNFSM4OFGLBAA .

d43m0nhLInt3r commented 3 years ago

Thats strange... I used the list for pi hole a while ago and it worked great. I tested it a few minutes ago with uBlock Origin and the page couldnt load. I never used PFblockerng so I cant tell you where the problem is. It should normally work if you setup it correctly.

chromecapone commented 3 years ago

Pfblockerng IS blocking SOME of the listed sites...but not everything in your list...and I suspect it's the way the pfblockerng handles the wildcard expressions at the bottom of your list.

(^|.)muscdn.com$

(^|.)musical.ly$

(^|.)tiktok.com$

(^|.)tiktok.org$

(^|.)tiktokcdn.com$

anyway, that's my GUESS.

On Thu, Aug 27, 2020 at 3:46 PM d43m0nhLInt3r notifications@github.com wrote:

Thats strange... I used the list for pi hole a while ago and it worked great. I tested it a few minutes ago with uBlock Origin and the page couldnt load. I never used PFblockerng so I cant tell you where the problem is.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/d43m0nhLInt3r/socialblocklists/issues/16#issuecomment-682154912, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYEIFVNUWYK74AKQ77DSC2Z2DANCNFSM4OFGLBAA .

ghost commented 3 years ago

Yeah, dns can't block regex. Neither can't the pihole (unless it goes in a separate regex file). You'll need to find a different list or create a small one of your own that blocks specific domains. I know of other lists, but I don't want to really advertise them here as I don't feel its fair to the dev.

chromecapone commented 3 years ago

I was able to grab the wildcard domains at the bottom of his list, enabled TLD blocking in pfblockerng-devel, and added those domains to the blacklist. (Enabling the TLD feature will block the subdomains as well). Seems like everything is working perfectly now.. So, for me, it was a two step process. I added d43m0nhLInt3r tiktok list... plus I added the domains at the bottom of the list right into pfblockerng and everything seems to be working now. I agree with you about advertising the lists here. If there's a way to PM me with the lists...I'd be interested in evaluating them. Thanks!

On Fri, Aug 28, 2020 at 11:26 AM gregf notifications@github.com wrote:

Yeah, dns can't block regex. Neither can't the pihole (unless it goes in a separate regex file). You'll need to find a different list or create a small one of your own that blocks specific domains. I know of other lists, but I don't want to really advertise them here as I don't feel its fair to the dev.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/d43m0nhLInt3r/socialblocklists/issues/16#issuecomment-682709303, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYBMWLZ4JNO4FJCQUB3SC7EC3ANCNFSM4OFGLBAA .

d43m0nhLInt3r commented 3 years ago

Can you send me the list. I would create a list for pfblockerng.

Yeah, dns can't block regex. Neither can't the pihole (unless it goes in a separate regex file). You'll need to find a different list or create a small one of your own that blocks specific domains. I know of other lists, but I don't want to really advertise them here as I don't feel its fair to the dev.

d43m0nhLInt3r commented 3 years ago

Sooo.. I just created a blacklist without regex. https://github.com/d43m0nhLInt3r/socialblocklists/blob/master/TikTok/tiktokblocklistWithoutRegex.txt

I was able to grab the wildcard domains at the bottom of his list, enabled TLD blocking in pfblockerng-devel, and added those domains to the blacklist. (Enabling the TLD feature will block the subdomains as well). Seems like everything is working perfectly now.. So, for me, it was a two step process. I added d43m0nhLInt3r tiktok list... plus I added the domains at the bottom of the list right into pfblockerng and everything seems to be working now. I agree with you about advertising the lists here. If there's a way to PM me with the lists...I'd be interested in evaluating them. Thanks! … On Fri, Aug 28, 2020 at 11:26 AM gregf @.***> wrote: Yeah, dns can't block regex. Neither can't the pihole (unless it goes in a separate regex file). You'll need to find a different list or create a small one of your own that blocks specific domains. I know of other lists, but I don't want to really advertise them here as I don't feel its fair to the dev. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#16 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYBMWLZ4JNO4FJCQUB3SC7EC3ANCNFSM4OFGLBAA .

chromecapone commented 3 years ago

Thank you for creating that! You're awesome!

So, I decided I would like to try your new list (without regex).... I removed everything in the blacklist and added a "without REGEX" feed.

I get the error message:

[ TikTokwithoutRegex ] Reload [ 08/28/20 16:15:32 ] . completed . IDN converted: [ can’t ] [ xn--cant-x96a ]. Whitelist: github.com|

Orig. Unique # Dups # White # TOP1M Final

3 2 0 1 0 1

Tiktok works at this point.

So, I disabled that feed and re-enabled the original list (without adding anything to the blacklist) ... and the original list is working perfectly now... tiktok is BLOCKED.

I am definitely pulling the rest of my hair out with this one.

Thanks so much for your help!

On Fri, Aug 28, 2020 at 4:03 PM d43m0nhLInt3r notifications@github.com wrote:

Sooo.. I just created a blacklist without regex. https://github.com/d43m0nhLInt3r/socialblocklists/blob/master/TikTok/tiktokblocklistWithoutRegex.txt

I was able to grab the wildcard domains at the bottom of his list, enabled TLD blocking in pfblockerng-devel, and added those domains to the blacklist. (Enabling the TLD feature will block the subdomains as well). Seems like everything is working perfectly now.. So, for me, it was a two step process. I added d43m0nhLInt3r tiktok list... plus I added the domains at the bottom of the list right into pfblockerng and everything seems to be working now. I agree with you about advertising the lists here. If there's a way to PM me with the lists...I'd be interested in evaluating them. Thanks! … <#m3334242495370906870> On Fri, Aug 28, 2020 at 11:26 AM gregf @.***> wrote: Yeah, dns can't block regex. Neither can't the pihole (unless it goes in a separate regex file). You'll need to find a different list or create a small one of your own that blocks specific domains. I know of other lists, but I don't want to really advertise them here as I don't feel its fair to the dev. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#16 (comment) https://github.com/d43m0nhLInt3r/socialblocklists/issues/16#issuecomment-682709303>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYBMWLZ4JNO4FJCQUB3SC7EC3ANCNFSM4OFGLBAA .

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/d43m0nhLInt3r/socialblocklists/issues/16#issuecomment-683123352, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYG5CVXGUHIRFLIBLD3SDAEQZANCNFSM4OFGLBAA .

chromecapone commented 3 years ago

I added the snapchat list just for fun...and it works perfectly as well with pfblockerng-devel.

On Fri, Aug 28, 2020 at 4:20 PM Anthony Capone capone@cap1.net wrote:

Thank you for creating that! You're awesome!

So, I decided I would like to try your new list (without regex).... I removed everything in the blacklist and added a "without REGEX" feed.

I get the error message:

[ TikTokwithoutRegex ] Reload [ 08/28/20 16:15:32 ] . completed . IDN converted: [ can’t ] [ xn--cant-x96a ]. Whitelist: github.com|

Orig. Unique # Dups # White # TOP1M Final

3 2 0 1 0 1

Tiktok works at this point.

So, I disabled that feed and re-enabled the original list (without adding anything to the blacklist) ... and the original list is working perfectly now... tiktok is BLOCKED.

I am definitely pulling the rest of my hair out with this one.

Thanks so much for your help!

On Fri, Aug 28, 2020 at 4:03 PM d43m0nhLInt3r notifications@github.com wrote:

Sooo.. I just created a blacklist without regex. https://github.com/d43m0nhLInt3r/socialblocklists/blob/master/TikTok/tiktokblocklistWithoutRegex.txt

I was able to grab the wildcard domains at the bottom of his list, enabled TLD blocking in pfblockerng-devel, and added those domains to the blacklist. (Enabling the TLD feature will block the subdomains as well). Seems like everything is working perfectly now.. So, for me, it was a two step process. I added d43m0nhLInt3r tiktok list... plus I added the domains at the bottom of the list right into pfblockerng and everything seems to be working now. I agree with you about advertising the lists here. If there's a way to PM me with the lists...I'd be interested in evaluating them. Thanks! … <#m_-7515168966884376532_m3334242495370906870> On Fri, Aug 28, 2020 at 11:26 AM gregf @.***> wrote: Yeah, dns can't block regex. Neither can't the pihole (unless it goes in a separate regex file). You'll need to find a different list or create a small one of your own that blocks specific domains. I know of other lists, but I don't want to really advertise them here as I don't feel its fair to the dev. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#16 (comment) https://github.com/d43m0nhLInt3r/socialblocklists/issues/16#issuecomment-682709303>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYBMWLZ4JNO4FJCQUB3SC7EC3ANCNFSM4OFGLBAA .

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/d43m0nhLInt3r/socialblocklists/issues/16#issuecomment-683123352, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMAUYG5CVXGUHIRFLIBLD3SDAEQZANCNFSM4OFGLBAA .