Skip to content

stream.md

Latest commit

 

History

History
45 lines (30 loc) · 1.37 KB

stream.md

File metadata and controls

45 lines (30 loc) · 1.37 KB

DynamoDB Stream — Batch Processing

A Lambda function that handles INSERT/MODIFY/DELETE events on items of a source DynamoDB table by batch processing the records and upserting/deleting processed items into/from a destination DynamoDB table. Partial batch failure reporting is enabled so that individual record failures do not cause the entire batch to be retried.

Architecture

The template sets up:

  1. Source Amazon DynamoDB Stream: Provides the stream of data events.
  2. AWS Lambda function: Batch processes stream records with partial failure reporting.
  3. Destination Amazon DynamoDB table: Stores the processed output.

Code

Deployment

Deploy the stack using:

make deploy STACK=stream

Data models

Model Description
SourceItem Read from the source table stream (id, name)
DestinationItem Written to the destination table (id, name)

Environment variables

Variable Description
SOURCE_TABLE_NAME Source DynamoDB table name (stream source)
DESTINATION_TABLE_NAME Destination DynamoDB table name
SERVICE_NAME Powertools service name
METRICS_NAMESPACE Powertools metrics namespace