From the course: Implementing Data Engineering Solutions Using Microsoft Fabric (DP-700) Cert Prep by Microsoft Press
Unlock this course with a free trial
Join today to access over 25,300 courses taught by industry experts.
Using windowing functions to query streaming data - Microsoft Fabric Tutorial
From the course: Implementing Data Engineering Solutions Using Microsoft Fabric (DP-700) Cert Prep by Microsoft Press
Using windowing functions to query streaming data
using windowing functions to query streaming data. Now when we're processing streaming data, we may wish to aggregate data over specific time periods. Now this is very, very useful to do any form of anomaly detection or alerting to look for patterns in the data. Now we've got five windowing functions to go through, and each of those windowing functions aggregates data over specific periods of time. The first one is the snapshot window, and it's the simplest windowing function. It groups events that have the same timestamp. So for example, if we want to answer the question of select the count of events that happened at the same time, we can use snapshots. So if we've got a timeline here, I can group four events that happened together at that specific point in time. Again, I can group that one event that happened at that point in time, those two events, and those three events. They all happen at the same time. So my aggregation is going to count all of those events. Now with Tumbling…
Contents
-
-
-
-
-
-
-
-
-
-
(Locked)
Learning objectives32s
-
(Locked)
Choosing between Eventstream, Spark Structured Streaming, and KQL for streaming3m 26s
-
(Locked)
Understanding KQL database native storage, followed storage, and OneLake shortcuts6m 11s
-
(Locked)
Using Eventstreams to process data6m 34s
-
(Locked)
Using Spark Structured Streaming to process data6m 41s
-
(Locked)
Using KQL to process data6m 25s
-
(Locked)
Using windowing functions to query streaming data6m 27s
-
(Locked)
Quiz2m 14s
-
(Locked)
-
-
-
-
-