From the course: Build a No-Code ETL Pipeline with Google BigQuery
Unlock this course with a free trial
Join today to access over 24,800 courses taught by industry experts.
Introduction to BigQuery Data Transfer Service - BigQuery Tutorial
From the course: Build a No-Code ETL Pipeline with Google BigQuery
Introduction to BigQuery Data Transfer Service
- [Instructor] Let us now learn about BigQuery Data Transfer Service. One of the biggest challenges with data is moving large volumes reliably between systems. This is where BigQuery Data Transfer Service comes in. In my experience, it saves me a lot of time and money by simplifying data transfers into BigQuery. So why use BigQuery Data Transfer Service or DTS for short? It's a reliable, scalable solution for automating large data transfers. It automates the process of loading data into BigQuery, and it works with several sources like Google Ads, YouTube, cloud storage, and more. Particularly in this course, we will see how it can ingest data from cloud storage. And the good news is that this service is mostly free. You only pay for the BigQuery storage and the queries that you run on your data, but you don't actually pay to get data into BigQuery. Now, setting up a transfer is pretty straightforward. First, you create a transfer configuration, which is like a recipe for your data…
Contents
-
-
-
-
(Locked)
How data load will work1m 40s
-
(Locked)
Introduction to data4m 44s
-
(Locked)
What is Google Cloud Storage?2m 42s
-
(Locked)
Put data in Google Cloud Storage3m 35s
-
(Locked)
Create table in BigQuery4m 35s
-
(Locked)
Introduction to BigQuery Data Transfer Service1m 43s
-
How we will manage data6m 4s
-
(Locked)
Use Transfer Service to ingest data6m 40s
-
(Locked)
Schedule transfers with Transfer Service3m 19s
-
(Locked)
Identify data transfer issues6m 18s
-
(Locked)
Common issues with data transfer5m 21s
-
(Locked)
-
-
-