From the course: End-to-End Data Engineering Project

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

Synchronizing and navigating through data

Synchronizing and navigating through data

From the course: End-to-End Data Engineering Project

Synchronizing and navigating through data

- [Instructor] It is time to run your first data sync. To do that, you just have to click on the sync now button in the status section of your connection. Now sit back and watch as your data makes its journey from source to destination. Take a short break and give the job a few minutes to complete. In my experience, it can take anywhere from five to 10 minutes for a job like this to finish. If you're go into the job history tab and then you select view logs, you can monitor what is happening behind the scenes. You can pause the video here and come back as soon as the first thing declares success. Now it is time to take a look into the tables created in our BigQuery data warehouse. Expand the raw_data dataset and you will notice several new tables. You will find some tables identified with the naming convention airbyte_raw and the stream name. These tables are like step one for Airbyte and the first ones that get loaded…

Contents