From the course: Implementing Data Engineering Solutions Using Microsoft Fabric (DP-700) Cert Prep by Microsoft Press

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

Using windowing functions to query streaming data

Using windowing functions to query streaming data

using windowing functions to query streaming data. Now when we're processing streaming data, we may wish to aggregate data over specific time periods. Now this is very, very useful to do any form of anomaly detection or alerting to look for patterns in the data. Now we've got five windowing functions to go through, and each of those windowing functions aggregates data over specific periods of time. The first one is the snapshot window, and it's the simplest windowing function. It groups events that have the same timestamp. So for example, if we want to answer the question of select the count of events that happened at the same time, we can use snapshots. So if we've got a timeline here, I can group four events that happened together at that specific point in time. Again, I can group that one event that happened at that point in time, those two events, and those three events. They all happen at the same time. So my aggregation is going to count all of those events. Now with Tumbling…

Contents