From the course: AWS Certified Data Engineer Associate (DEA-C01) Cert Prep
Unlock this course with a free trial
Join today to access over 25,300 courses taught by industry experts.
Amazon Kinesis Data Streams
From the course: AWS Certified Data Engineer Associate (DEA-C01) Cert Prep
Amazon Kinesis Data Streams
- [Instructor] Amazon Kinesis Data Streams is a service that scales elastically for near realtime processing of streaming data. The service durably stores data in large streams for near realtime processing with a propagation delay as low as 200 milliseconds. In this lesson, we'll explain how to configure a data stream and read and write data into it. Then we'll do a lab where we create a data stream. Amazon Kinesis data streams is designed to ingest streaming data records from multiple sources. The data is a sequence of records such as log data, social media, telemetry data from IOT devices, or clickstream data. It is designed to enable realtime processing of streaming data by downstream applications. Often these data stream applications are custom applications running on EC2, however, several AWS services integrate directly with Kinesis Data Streams. One is Amazon Managed Service for Apache Flink, which uses Apache Flink to process and perform analytics on the streaming data before…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
(Locked)
Introduction38s
-
Data ingestion scenarios3m 5s
-
(Locked)
AWS Database Migration Service3m 22s
-
(Locked)
Schema conversion2m 52s
-
(Locked)
Change data capture1m 30s
-
(Locked)
AWS DataSync1m 2s
-
(Locked)
AWS Storage Gateway1m 10s
-
(Locked)
AWS Snow Family2m 27s
-
(Locked)
AWS Transfer Family2m 11s
-
(Locked)
AWS Glue59s
-
(Locked)
AWS Glue Data Catalog1m 17s
-
(Locked)
Hands-on learning: Create an AWS Glue Data Catalog3m 13s
-
(Locked)
AWS Glue Crawler45s
-
(Locked)
Hands-on learning: Create an AWS Glue Crawler2m 6s
-
(Locked)
Amazon Kinesis Data Streams9m 18s
-
(Locked)
Hands-on learning: Create a data stream3m 30s
-
(Locked)
Consumer throughput1m 21s
-
(Locked)
Reading data with AWS Lambda2m 28s
-
(Locked)
AWS Lambda concurrency2m 28s
-
(Locked)
Using Amazon EFS with AWS Lambda1m 25s
-
(Locked)
Hands-on learning: Create and use an AWS Lambda function3m 50s
-
(Locked)
Amazon Kinesis Client Library (KCL)2m 52s
-
(Locked)
Amazon MSK3m 19s
-
(Locked)
Amazon Data Firehose4m 9s
-
Hands-on learning: Configure an Amazon Data Firehose stream5m 33s
-
(Locked)
Amazon DynamoDB Streams2m 31s
-
(Locked)
AWS Glue Schema Registry1m 9s
-
(Locked)
Amazon AppFlow4m 41s
-
(Locked)
Consume data APIs2m 21s
-
(Locked)
Data exchange1m 31s
-
(Locked)
-
-
-
-
-
-