lazywithclass / winston-cloudwatch

Send logs to Amazon Cloudwatch using Winston.
MIT License
258 stars 105 forks source link
aws aws-sdk javascript logging winston

winston-cloudwatch v6.3.0

:warning: WARNING
I realised I don't have time anymore to work on this. It's very likely no more updates will be made on this project.

Build Status Coverage Status

Send logs to Amazon Cloudwatch using Winston

Starting from version 3.0.0 we moved aws-sdk into devDependencies to reduce the size of the package, so if you're not using this on AWS Lambda make sure you add aws-sdk dependency into your application package.json.

If you were using this library before version 2.0.0 have a look at the migration guide for Winston and at the updated examples.

Features

Installing

$ npm install --save winston winston-cloudwatch @aws-sdk/client-cloudwatch-logs

Also consider that we have both winston and @aws-sdk/client-cloudwatch-logs configured as peerDependencies.

Configuring

AWS configuration works using ~/.aws/credentials as written in AWS JavaScript SDK guide.

As a best practice remember to use one stream per resource, so for example if you have 4 servers you should setup 4 streams on AWS CloudWatch Logs, this is a general best practice to avoid incurring in token clashes and to avoid limits of the service (see usage for more).

Credentials

Use awsOptions to set your credentials, like so:

new WinstonCloudWatch({
  ...,
  awsOptions: {
    credentials: {
      accessKeyId,
      secretAccessKey,
    },
    region,
  }
})

Region note

As specified in the docs:

The AWS SDK for Node.js doesn't select the region by default.

so you should take care of that. See the examples below.

If either the group or the stream do not exist they will be created for you.

AWS UI

For displaying time in AWS CloudWatch UI you should click on the gear in the top right corner in the page with your logs and enable checkbox "Creation Time".

TypeScript

Remember to install types for both winston and this library.

Usage

Please refer to AWS CloudWatch Logs documentation for possible contraints that might affect you. Also have a look at AWS CloudWatch Logs limits.

In ES5

var winston = require('winston'),
    WinstonCloudWatch = require('winston-cloudwatch');

In ES6

import { createLogger, format } from 'winston';
import * as WinstonCloudWatch from 'winston-cloudwatch';

export const log = createLogger({
  level: 'debug',
  format: format.json(),
  transports: [
    new WinstonCloudWatch({
      level: 'error',
      logGroupName: 'groupName',
      logStreamName: 'errors',
      awsRegion: 'eu-west-3'
      }),
  ]
});

You can also specify a function for the logGroupName and logStreamName options. This is handy if you are using this module in a server, say with express, as it enables you to easily split streams across dates, for example. There is an example of this here.

Logging to multiple streams

You could also log to multiple streams with / without different log levels, have a look at this example.

Consider that when using this feature you will have two instances of winston-cloudwatch, each with its own setInterval running.

Programmatically flush logs and exit

Think AWS Lambda for example, you don't want to leave the process running there for ever waiting for logs to arrive.

You could have winston-cloudwatch to flush and stop the setInterval loop (thus exiting), have a look at this example.

Custom AWS.CloudWatchLogs instance

const AWS = require('aws-sdk');

AWS.config.update({
  region: 'us-east-1',
});

winston.add(new WinstonCloudWatch({
  cloudWatchLogs: new AWS.CloudWatchLogs(),
  logGroupName: 'testing',
  logStreamName: 'first'
}));

Options

This is the list of options you could pass as argument to winston.add:

AWS keys are usually picked by aws-sdk so you don't have to specify them, I provided the option just in case. Remember that awsRegion should still be set if you're using IAM roles.

Examples

Please refer to the provided examples for more hints.

Note that when running the examples the process will not exit because of the setInterval

Simulation

You could simulate how winston-cloudwatch runs by using the files in examples/simulate:

At this point you could for example run log.sh in a tight loop, like so

$ while true; do ./examples/simulate/log.sh $PID; sleep 0.2; done

and see what happens in the library, this might be useful to test if you need more streams for example, all you need to do is change running-process.js to better reflect your needs.

If you want more detailed information you could do

$ WINSTON_CLOUDWATCH_DEBUG=true node examples/simulate/running-process.js

which will print lots of debug statements as you might've guessed.