From the course: AWS Certified Data Engineer Associate (DEA-C01) Cert Prep
Unlock this course with a free trial
Join today to access over 25,300 courses taught by industry experts.
AWS Glue
From the course: AWS Certified Data Engineer Associate (DEA-C01) Cert Prep
AWS Glue
- [Instructor] AWS Glue is one of the most important services for data pipelines. In this lesson we'll introduce AWS Glue and some of its capabilities. AWS Glue is a fully managed serverless service that makes it easy to extract, transform, and load your data in your data pipeline. It supports many use cases for ingestion, including ETL, ELT, batch and streaming. You could use it for preparing data for analytics, and it runs Glue jobs on a fully managed and scalable Apache Spark environment. Glue Studio features a drag and drop editor, so you can create ETL jobs without writing code. Glue Crawlers can discover and classify data in schemas and then store the metadata in the Glue data catalog for you. This could be done for a variety of data stores, including S3, RedShift, RDS, DynamoDB, MongoDB, and other stores over at JDBC connection.
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
(Locked)
Introduction38s
-
Data ingestion scenarios3m 5s
-
(Locked)
AWS Database Migration Service3m 22s
-
(Locked)
Schema conversion2m 52s
-
(Locked)
Change data capture1m 30s
-
(Locked)
AWS DataSync1m 2s
-
(Locked)
AWS Storage Gateway1m 10s
-
(Locked)
AWS Snow Family2m 27s
-
(Locked)
AWS Transfer Family2m 11s
-
(Locked)
AWS Glue59s
-
(Locked)
AWS Glue Data Catalog1m 17s
-
(Locked)
Hands-on learning: Create an AWS Glue Data Catalog3m 13s
-
(Locked)
AWS Glue Crawler45s
-
(Locked)
Hands-on learning: Create an AWS Glue Crawler2m 6s
-
(Locked)
Amazon Kinesis Data Streams9m 18s
-
(Locked)
Hands-on learning: Create a data stream3m 30s
-
(Locked)
Consumer throughput1m 21s
-
(Locked)
Reading data with AWS Lambda2m 28s
-
(Locked)
AWS Lambda concurrency2m 28s
-
(Locked)
Using Amazon EFS with AWS Lambda1m 25s
-
(Locked)
Hands-on learning: Create and use an AWS Lambda function3m 50s
-
(Locked)
Amazon Kinesis Client Library (KCL)2m 52s
-
(Locked)
Amazon MSK3m 19s
-
(Locked)
Amazon Data Firehose4m 9s
-
Hands-on learning: Configure an Amazon Data Firehose stream5m 33s
-
(Locked)
Amazon DynamoDB Streams2m 31s
-
(Locked)
AWS Glue Schema Registry1m 9s
-
(Locked)
Amazon AppFlow4m 41s
-
(Locked)
Consume data APIs2m 21s
-
(Locked)
Data exchange1m 31s
-
(Locked)
-
-
-
-
-
-