sensepost / gowitness

🔍 gowitness - a golang, web screenshot utility using Chrome Headless
GNU General Public License v3.0
2.79k stars 322 forks source link

too many SQL variables #159

Open r00tSe7en opened 1 year ago

r00tSe7en commented 1 year ago

2022/10/18 10:30:36 /root/go/pkg/mod/github.com/sensepost/gowitness@v0.0.0-20220911121411-c9c6b17993f2/cmd/merge.go:141 too many SQL variables

gowitness merge --input-path all/allweb_screenshots/tmp_sqlite3 -o all/allweb_screenshots/gowitness.sqlite3

leonjza commented 1 year ago

Guessing the batch size is too big here. Might be worth reducing the 500 here to say 100 or so and see.

r00tSe7en commented 1 year ago

Setting 100 has no effect. It may need to be optimized. If there is more data to be merged, it will fail