dnif-archive / DigiVigi

GNU General Public License v3.0
1 stars 7 forks source link

AWS log forwarding #9

Open shreyaskulkarni412 opened 6 years ago

shreyaskulkarni412 commented 6 years ago

Hello Team,

I have hosted one site on AWS which in node js and MongoDB. I want to forward the logs of the site to dnif.

Have anyone any idea regarding it??

PRASHANT-SAWANT commented 6 years ago

Hey @shreyaskulkarni412 anything to look forward on this thread? This could be a great addition to this project and for future references.

shreyaskulkarni412 commented 6 years ago

Yes, @PRASHANT-SAWANT @aakratisahu @Sharbanibasu23 We can forward the access log of a site by installing rsys log and editing 50-default.conf file which is present in /etc/rsyslog.d/ folder of ubuntu. Now I can generate access log for my website by using "winston" npm packages but now problem occurs in formatting because DNIF inbuilt parser can parse only the apache access log (called CLF format) so if we want proper intelligence from DNIF platform we have to convert our log to CLF format.

PRASHANT-SAWANT commented 6 years ago

Wow.. that is either a limitation or it is a mandate feature.