afilipovich / gglsbl

Python client library for Google Safe Browsing API
Apache License 2.0
82 stars 37 forks source link

sqlite3.IntegrityError: UNIQUE constraint failed #55

Open lkc0626 opened 10 months ago

lkc0626 commented 10 months ago

Hello,

I'm using this library to check Google Safe Browsing URLs. I have collected responses from "get_threats_update" into JSON and then tried to insert them into the DB. However, after inserting it into DB for a while, it gives me this integrity error at line 323 in Storage.py (when inserting hash_prefix with populate_hash_prefix_list function): sqlite3.IntegrityError: UNIQUE constraint failed: hash_prefix.value, hash_prefix.threat_type, hash_prefix.platform_type, hash_prefix.threat_entry_type

For this function, is it possible to add INSERT OR IGNORE? or does it need to check for integrity? What should happen if integrity fails? Is it supposed to get a full update instead of a partial update?

Thank you in advance.