From the course: Implementing Data Engineering Solutions Using Microsoft Fabric (DP-700) Cert Prep by Microsoft Press

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

Troubleshooting and resolving dataflow errors

Troubleshooting and resolving dataflow errors

Troubleshooting and resolving data flow errors. When we're looking at data flow errors, we can go into the monitoring hub and we can filter for data flows that have failed. We can look at the transforms inside the data flow to see which has failed. So for example, I can click on a transformation step here and see the error. So that transformation step will show what has actually happened and any errors that's occurred. Now, common issues with data flows, we could have timeouts. Now this could be due to long running queries or large data sets that we're trying to process. There could be connector issues themselves. There could be gateway or authentication issues. And there could be some mismatched permissions or access control configurations that we need to update. Now in terms of transformation errors, there could be issues with schema drift between the source and the destination. So we have to be careful about that. There could also be data type mismatches during that transformation.…

Contents