Learned about Google BigQuery's performances today:
Started by storing dataset in a bucket in Parquet format.
Created an external table for flexibility and a standard table for performance. Compared performances between them for insights.
Estimated amount of data read when querying both tables. Optimized queries based on these metrics for cost-effective operations.
Dived into column partitioning and clustering!
Structured tables for efficient querying, minimizing unnecessary data read. This can lead to significant cost savings.
#BigQuery #DataOptimisation #GoogleCloud #DataTalksClub