Skip to content

data, code and conversation

from Andy Boothe

Month: December 2020

Posted on 2020-12-262022-05-17

BigQuery Twitter Schema

I was investigating the feasibility of putting natively-formatted Twitter data into BigQuery, and got pretty far along the way before deciding to go another direction. I found the schema in the twitter-for-bigquery project to be incomplete for my needs, so I made a new schema of my own. I’m making the schema available here in case it’s of use to anyone else.

Continue reading “BigQuery Twitter Schema”

Recent Posts

  • AI is Getting Really Useful for SQL
  • Introducing Rapier
  • Jackson CSV Serialization and Deserialization from the Ground Up
  • Regex for ISO 3166-1 Country Codes
  • AWS API Gateway Gotchas & Lessons Learned

Recent Comments

  • Francisca GVG on AWS SageMaker Object Detection Training Gotchas
  • Clara on Reverse Engineering with ChatGPT: An Example
  • Reverse Engineering with ChatGPT: An Example - "I used ChatGPT 4 to untangle a particularly terse bit of code, and was — frankly — shocked at how well it did." - CodeGurus on Reverse Engineering with ChatGPT: An Example

Archives

  • March 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • July 2024
  • April 2024
  • March 2024
  • February 2024
  • January 2024
  • December 2023
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • May 2023
  • April 2023
  • March 2023
  • November 2022
  • September 2022
  • August 2022
  • July 2022
  • May 2022
  • April 2022
  • January 2021
  • December 2020
  • August 2018
  • April 2018
  • January 2013
  • August 2012
  • May 2012
  • April 2012
  • April 2010
  • March 2010

Categories

  • aleph0
  • API Architecture
  • API Gateway
  • arachnio
  • Arachnio
  • Architecture
  • AWS
  • BigQuery
  • ChatGPT
  • Cloud Architecture
  • Cloud Providers
  • Code Snippets
  • Data Science
  • Data Stores
  • Datasets
  • GCP
  • Gotchas
  • HumanGraphics
  • Internationalization
  • ISO 15924
  • Jackson
  • Java
  • Java 17
  • Java 18
  • Java 19
  • Java 20
  • Java 21
  • Lambda
  • Machine Learning
  • Memory Optimization
  • Model Training
  • Musings
  • Open Data
  • Open Source
  • Performance Benchmarking
  • Performance Optimization
  • PostgreSQL
  • Python
  • Refactoring
  • Relational Databases
  • SageMaker
  • Serverless
  • Social Media
  • Software Engineering
  • Software Performance
  • Software Testing
  • Step Functions
  • Twitter
  • Uncategorized
  • Unicode
  • WebFlow

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Social Links

Proudly powered by WordPress