From the course: Build a No-Code ETL Pipeline with Google BigQuery

Unlock this course with a free trial

Join today to access over 24,500 courses taught by industry experts.

Common issues with data transfer

Common issues with data transfer - BigQuery Tutorial

From the course: Build a No-Code ETL Pipeline with Google BigQuery

Start my 1-month free trial Buy for my team

Common issues with data transfer

“

- [Instructor] Now that we've seen how to identify and debug specific errors, let us look at the general overview of the most common type of errors that you will encounter in Data Transfer Service. So the biggest category by far is that of explicit errors. So these are errors where your data transfer fails explicitly, and then you get an error message that you can look at. Now, the first error we've already seen, the BigQuery table is missing, so data transfer doesn't have any place to put the data. And the solution of course, is to create the table, or to point your configuration to the correct location of your table. A similar issue is on Google Cloud Storage's side, if the file is missing, where the data transfer is looking for it. And the solution of course is to put the file in the right place, or fix the Google Cloud Storage address in the transfer configuration so it can find the correct file. The other issue that we have seen is schema mismatch. So the table is expecting the…

Contents