From the course: Data Engineering Foundations
Join today to access over 24,800 courses taught by industry experts.
Essential tools for data engineering
From the course: Data Engineering Foundations
Essential tools for data engineering
- A Data Engineer moves data from several sources, processes or cleans it, and finally loads it into an analytical database. They do this using several tools. This video will give you an overview of how data engineers fulfill their tasks using these tools. Now, data engineering tools can be broadly classified into three categories. First is storage, that is databases. Second is processing frameworks. And third category is automation, that is scheduling tools. So, let's go over each one of them. First one, we have databases. So Data Engineers are expert users of database systems. Roughly speaking, database is a computer system that holds large amount of data. You might have heard of SQL or NoSQL databases. Most applications rely on databases to provide certain functionality. For example, in an e-commerce application, a database holds product data like description, prices, or amount in stock. On the other hand,…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.