AWS S3 Lambda

Overview

Connector names3-lambda
Typesource
Delivery guaranteeexactly once

Getting Started

Sending a data stream from S3 to Decodable is accomplished in two stages, first by populating an AWS Kinesis stream via an AWS lambda function, and then by adding and configuring a Kinesis source connector in Decodable.

Create Kinesis Data Source

To capture events for S3, an AWS lambda function is used to populate an AWS Kinesis stream.

  1. Configure S3 read permissions
  2. Create a Kinesis stream
  3. Configure Kinesis write permissions
  4. Create the AWS lambda function
  5. Create a notification trigger

For more detailed information, please refer to the S3 Lambda example in the Decodable GitHub repository.

Configure A Kinesis Source

Sign in to the Decodable Web Console and follow the configuration steps provided for the AWS Kinesis Connector to create a source connector. For examples of using the command line tools or scripting, see the How To guides.

Additional S3 Lambda Support
If you are interested in a direct Decodable Connector for S3 via an AWS lambda function, please contact [email protected] or join our Slack community and let us know!