needmorecowbell / sniff-paste

Pastebin OSINT Harvester
318 stars 41 forks source link

send for analysis to needmorecowbell/funnel ingestion #4

Open needmorecowbell opened 5 years ago

needmorecowbell commented 5 years ago

Add option to bypass filtering, instead acting as a pipeline for funnel. ie: scrape all pastes and format them by content body and url. Pipe this stream of pastes to funnel, which will check each against it's yara library for valuable content.

needmorecowbell commented 5 years ago

To clarify, this will just be a general output stream, over a tcp port. It will send json/csv (probably json) objects over the socket, for ingestion by any tool. Funnel is just an example of a tool that could use it. So each json object will include a paste with as much content about the paste as possible.