From the course: Build a No-Code ETL Pipeline with Google BigQuery

Unlock this course with a free trial

Join today to access over 24,800 courses taught by industry experts.

Identify data transfer issues

Identify data transfer issues - BigQuery Tutorial

From the course: Build a No-Code ETL Pipeline with Google BigQuery

Start my 1-month free trial Buy for my team

Identify data transfer issues

“

- [Instructor] Let us now look at the main issues that we can encounter when running data transfers and how to troubleshoot them. What I did here is that I went on BigQuery, and I deleted our table. And then I came back to Data Transfer Service and I ran a manual transfer. You can do that, by the way, by selecting Run Transfer Now. But I've already done this, and you can see that the last transfer was a failure. And the reason for the failure is that the table was not found. So what is happening here is that Data Transfer is getting our data, and it's looking to insert it in the table, but the table is not there. And it does not have the ability to create the table. You have to do that beforehand. You have to create the table with the correct schema to receive your data. And if I go ahead and click on my transfer, I should be able to see the logs on the right which might give me more details about the issue. So if I expand the JSON payload here, I can see the message, error code 5…

Contents