From the course: Data Engineering on AWS: Data Cataloging, Processing, Analytics, and Visualization

Unlock this course with a free trial

Join today to access over 25,600 courses taught by industry experts.

AWS Lake Formation

AWS Lake Formation - Amazon Web Services (AWS) Tutorial

From the course: Data Engineering on AWS: Data Cataloging, Processing, Analytics, and Visualization

Start my 1-month free trial Buy for my team

AWS Lake Formation

“

- [Instructor] Lake Formation meant as a system for making it easier to set up a secure data lake. AWS's tagline for Lake Formation is makes it easy to set up a secure data lake in days. It manages loading your data from an external source and monitoring those data flows. So it allows you to connect to your existing data sources, whether they're already in S3 or in some on-premise database. It can set up partitions for you. It can help you manage encryption and manage the keys surrounding that. It also let you set up transformations associated with that data. For example, if you want to transform to new data formats like Parquet or ORC or any other transformation. since it is built on top of Glue, so pretty much anything Glue ETL or any of the Glue features can do, it is available to you. If Spark can do this, then Lake Formation can do this too. It's just using Glue under the hood to apply those transformations. It…

Contents