From the course: Data Management Essential Training
Unlock this course with a free trial
Join today to access over 25,300 courses taught by industry experts.
Big data processing
From the course: Data Management Essential Training
Big data processing
- [Narrator] Big data has become a buzzword in organizations over the last few years, and it comes with a different set of challenges than more traditional data sources. But first, what even is big data in the data world? Big data is often defined by the three Vs. Volume, velocity, and variety. Volume is the sheer amount of the data. This is often measured in terabytes, petabytes, or even exabytes. As more and more devices are connected to the internet, it's becoming easier to create huge amounts of data. The second V is velocity, and this is the speed in which data is created, processed and used. Think about the stock exchange and how many transactions and price changes happen in every second. The third V is variety. The data doesn't always have to be the same type. Some could be structured, some could be unstructured, but this combination can bring challenges, but also deep insights. Now that we know what big data is, it's easier to see some of the challenges we might face as we try…
Contents
-
-
-
-
-
(Locked)
Introduction to data processing1m 28s
-
(Locked)
Data cleaning and preprocessing2m 37s
-
(Locked)
Data transformation techniques2m 39s
-
(Locked)
Extract, transform, load (ETL) processes3m 19s
-
(Locked)
Data integration approaches3m 7s
-
(Locked)
Real-time data processing1m 45s
-
(Locked)
Big data processing2m 3s
-
(Locked)
Challenges in data processing and integration2m 2s
-
(Locked)
Practical look at pipelines4m 47s
-
(Locked)
-
-
-
-
-
-