From the course: Complete Guide to Google BigQuery for Data and ML Engineers

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

DataFrames for data exploration

DataFrames for data exploration

- Okay, in this next lesson we're going to do a little data exploration, but rather than use SQL, we're going to work with Python. So here what I want to do is basically do an overview of DataFrames and just take a look at working with BigQuery BigFrames and using notebooks for data exploration and look at how we can basically get information for data cleansing and also some descriptive statistics that we can use for understanding the quality of our data. So let's jump over to BigQuery. And what I'm going to do here is I'm going to work with retail dataset. Now let's just quickly review. We have three tables here. We have products which have a product ID, name, category, and price. And that's what some of the data looks like. We also have sales transactions, where we have a transaction ID, a store ID, and a product ID. And then we have some measures like quantity, the transaction date, and the total amount, and that's what some of that data looks like. And then we also have stores…

Contents