From the course: Snowflake SnowPro Core Cert Prep

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

Data spilling

Data spilling - Snowflake Tutorial

From the course: Snowflake SnowPro Core Cert Prep

Start my 1-month free trial Buy for my team

Data spilling

“

So if there's one big health warning within your query plans is to look out for data spilling to disk. And in all likelihood, you will get questions on this in the SnowPro core certification. Now, data spilling indicates that memory in your virtual warehouse isn't large enough to service your workload. And so when this happens, data needs to be processed somewhere, and if there's no memory left within your warehouse, the disk is the next option. And the first level to this is the local disk storage, which is essentially that SSD cache we mentioned a little earlier in this course. This is followed by the remote disk, which is the most inefficient place to process data. So when data spills, files relating to your data set are created and retrieved on disk behind the scenes, massively inefficient in comparison to working with data in memory. So how do you spot this? Well, you go into your query profile and you will see something like this, where the red arrow is pointing to the spilling…

Contents