How to Export Your Universal Analytics (GA3) Data the Fastest & Easiest Way [w/ Free Templates Included]
The Announcement Google has announced that all customers will lose access to Universal Analytics properties and API starting on July 1, 2024. Here is what Google says will happen: What you should know: So with that, I have spent the last couple of months reverse-engineering the Universal Analytics platform reports and found a way to […]
A Beginner Data Engineer Project: Extract Random Jokes via API with Python (Part 2)
This is Part 2 of extracting random jokes from an API and loading it into a BigQuery table via a data pipeline aka python script. In the first part, here’s what we went over: In this part, we’ll go over authenticating, connecting to, and loading data into a BigQuery table. Let’s jump right in… Authenticate […]
A Beginner Data Engineer Project: Extract Random Jokes via API with Python (Part 1)
In this Part 1 project, I’ll walk through creating a python script to extract random jokes from the Official Random Joke API. Click here for Part 2. https://official-joke-api.appspot.com/random_joke Clicking on the link above will give you data on a random joke. Here’s what we’ll do in this project (feel free to follow along with your […]
What Are Python Lambda Functions?
I learned python lambda functions from a codecademy.com tutorial – highly recommend. My definition: A one-liner for defining a function. Example: Notes: Adding if… else statements to our lambda functions: Template: <WHAT TO RETURN IF STATEMENT IS TRUE> if <IF STATEMENT> else <WHAT TO RETURN IF STATEMENT IS FALSE> Example: Notes: More Examples:
How to Make a BigQuery Real-Time MTD Job Cost Monitoring Dashboard (Part 1): Setting Up the Data
In this part 1 post, we’ll go over Setting Up the Data: In part 2, we’ll go over Creating the Report: These will help you to: Intro This is a report you could use to help monitor your real-time usage of BigQuery. The first 1TB of processed data is free per month, but any after […]
3 Things You Need to Get Paid More
1. Knowledge This is where you: And you work to gain knowledge “depth”. The more depth you know about ONE thing, the better you can get paid for what you do. Examples: In terms of fitness and being a personal trainer, gaining deeper knowledge would look like this: In terms of being a “marketing guru”, […]
How to Connect BigQuery with dbt
dbt is a great data modeling tool you can use to help you model GA4 data. This post will cover how to connect your BigQuery databases with dbt. First off… After you connect your GA4 account with a BigQuery project, you will have raw GA4 data flowing in constantly from GA4 to a BigQuery table. […]
How to Model GA4 Data Easier in BigQuery with this Helpful Tool
Issues with modeling data strictly from inside BigQuery: What I found while modeling GA4 data in BigQuery was: Enter the solution… What is dbt? On their website, it says; dbt is a SQL-first transformation workflow that lets teams quickly and collaboratively deploy analytics code following software engineering best practices like modularity, portability, CI/CD, and documentation. […]
When to Use IF NULL THEN 0 (How to Handle Null Values in SQL)
A couple of questions I’ve always had are: Why is this relevant? When working with Google Analytics data, many times you will come across your conversion events in their own separate column. What if you’re tracking multiple conversion types and you want to sum up all of them? If you only implemented conversion tracking starting […]
GA4 & BigQuery: A SQL Model for a Base Events Table (How to Unnest Fields)
Introduction to GA4 Public Dataset in BigQuery In this post, we’ll be using the GA4 public dataset in BigQuery. You will need a Google Cloud Platform account to access this. Using the sample dataset, you’ll see date sharded tables that look like this: Each day’s worth of data exists in its own date sharded table. […]