Error while creating URL-List

gabstopper / smc-python

Forcepoint Security Management Center python library:(Moved to official Forcepoint repo)

https://github.com/Forcepoint/fp-NGFW-SMC-python

Apache License 2.0

29 stars 13 forks source link

Error while creating URL-List #74

Open Alrexxar opened 4 years ago

Alrexxar commented 4 years ago

I try to create a dynamically updated URL-List to handle some Emotet outbreaks. For that im using the following online blacklist: 'https://urlhaus.abuse.ch/downloads/text_online/' Apparently some of the URLs in there are seen as invalid for the SMC. Is there a way to ignore invalid URLs while doing an URLListApplication.update_or_create?

Best Regards Alrexxar

gabstopper commented 4 years ago

Hi Alrexxar,

Do you have a couple sample URLs that do not work by chance? There are a couple ways we could potentially solve this (i.e. client vs. server side).

Thank you,

David

Alrexxar commented 4 years ago

The following Urls are incorrect: 24.54.106.17/invoice/invoice.zip?bkdlpescehu=bobtayl@highway1.? doc-04-5g-docs.googleusercontent.com/docs/securesc/ha0ro937gcuc7l7deffksulhg5h7mbp1/1kcrg4durrlvq45ha3mg62i6sj1i70er/1580277600000/12277769630439086412/*/16-YdjYX1lpawpPUzh-mMlICQ45WSxzaS?e=download

There were a couple of the google docs links and i guess the asterisk is the char that makes it invalid.

Alrexxar commented 4 years ago

Are you able to get the Regex which validates the URL in the SMC? Maybe you could add a flag like --ignore invalid or something

Alrexxar commented 4 years ago

Do you have any news already? Or would it help you to open a ticket at the partner portal too?