This is AWS Serverless Application Model application for processing data sent to Amazon Kinesis Firehose by Cloudwatch Logs subscription filters.

Table of Contents generated with DocToc

• Getting Started
  • Prerequisites
  • Installing
  • Packaging
  • Deploying
• Development & Test
  • Available npm tasks
• Authors
• License

• AWS CLI
• Node.js v4.3 or later.
• S3 bucket to host artifacts uploaded by CloudFormation e.g. Lambda ZIP deployment packages

You can use the following command to create the Amazon S3 bucket, say in us-east-1 region

aws s3 mb s3://<my-bucket-name> --region us-east-1

Rename .npmrc.sample into .nprmc. Modify this file according to match your own settings

Then install node package dependencies:

npm install

To build the Serverles Application Module deployment package:

npm run build:zip

This will package the necessary Lambda function(s) and dependencies into one local deployment zip as specified in package.json build script. i.e. it creates kinesis-firehose-cloudwatch-logs-processor.zip

Then upload all local artifacts needed by the SAM template to your previously created S3 bucket. You can do this either using npm or AWS CLI

Upload using NPM:

Before you run this command please ensure that you have set correct values in your application .npmrc

npm run build:package

Upload using AWS CLI

aws cloudformation package
    --template template.yaml
    --s3-bucket <my-bucket-name>
    --output-template-file template.output.yaml

The command returns a copy of the SAM template, in this case template.output.yaml, replacing all references to local artifacts with the S3 location where the command uploaded the artifacts. In particular, CodeUri property of the Lambda resource points to the deployment zip kinesis-firehose-cloudwatch-logs-processor.zip in the Amazon S3 bucket that you specified.

Deploy using NPM:

Before you run this command please ensure that you have set correct values in your application .npmrc

npm run build:deployment

Deploy using AWS CLI

aws cloudformation deploy
    --template $(pwd)/template.output.yaml
    --capabilities CAPABILITY_IAM --stack-name my-kinesis-firehose-cloudwatch-logs-processor

For each serverless application, you can use the following npm tasks:

• Tarik Makota - tmakota
• Kevin Deng - kevincdeng

The kinesis-firehose-cloudwatch-logs-processor AWS Lambda blueprints & application templates are released under the Apache 2.0 license. Details can be found in the LICENSE file.