Scaling Pandas to Petabytes — The Architecture and Tradeoffs of BigQuery DataFrames: odbms.org/blog/2026/03/techn… by @odbmsorg ⬇️ docs.cloud.google.com/bigque… BigQuery DataFrames (BigFrames) is an open-source Python library that provides a Pandas-compatible API for analyzing data stored in BigQuery. Unlike Pandas, which loads data into local memory, BigFrames translates operations into BigQuery SQL, enabling data scientists to work with terabyte-scale datasets using familiar Pandas syntax.

If you have a DataFrame, you can run Gemini on all of the rows using BigQuery. import bigframes.bigquery as bbq movies['title'] = bbq.ai.generate( ("What is the movie title for this poster?", movies['poster'])).struct.field("result") medium.com/google-cloud/ai-f…

Did you know Ibis and @Google #BigQuery are a match made in the clouds☁️✨ Check out this post from @FriendlinessDev on how to query BigQuery with #Python using Ibis. cloud.google.com/community/t…

My next article is on how building cities for people instead of cars will make us all richer. Just one example: it turns out every random midsized intersection in every city wastes enough space for at least FORTY EIGHT pretty nice two bedroom apartments!

We are happy to announce the release candidate of pandas 2.0.0. It can be installed from our conda-forge and PyPI packages via mamba, conda or pip, for example: mamba install -c conda-forge/label/pandas_rc pandas==2.0.0rc0 python -m pip install --upgrade --pre pandas==2.0.0rc0

I approve of Sarah's message! You can do it, Seattle! youtube.com/watch?v=OwZmIDpU…

We shouldn't blame candidates just for running. It's their right, and their views add perspective even if we don't agree with them. If there's an error, blame the voting method. @AaronBlake at @washingtonpost is wrong. @SarahPalinUSA didn't cost the GOP a House seat. RCV did.

How favorite betrayal works in RCV: youtu.be/JtKAScORevQ

Rec Room vs Horizon Worlds

Impostor syndrome: “I don't know what I'm doing. It's only a matter of time until everyone finds out." Growth mindset: "I don't know what I'm doing yet. It's only a matter of time until I figure it out." The highest form of self-confidence is believing in your ability to learn.

I recently gave this #pandas talk on how pandas is at a cross roads and where we can from here. enjoy!youtube.com/watch?v=7JHqxODJ…

debugging strategy: write a message asking for help

Basic fact all graphics coders should know: To uniformly sample points in a disk, you'd think you could just pick a random radius r ∈ [0,1] and a random angle θ ∈ [0,2π] to generate points r (cos θ, sin θ). This doesn't work! …But take the square root of r, and it does! 1/3

Come work with me! We're building libraries, connectors, and code samples to help developers, data scientists, and data engineers use #BigQuery. US: careers.google.com/jobs/resu… Canada: careers.google.com/jobs/resu…

So glad to see this open-source Data Validation Tool has launched! It was great to collaborate on this and get to use @IbisData in a production setting cloud.google.com/blog/produc…

Don't get cross with cross platform data validation; get the Data Validation Tool (DVT). DVT is an #opensourced Python CLI tool that provides an automated and repeatable solution for validation across different environments. Learn more about it below ↓ cloud.google.com/blog/produc…

Top Google search trends data is now available as a public dataset in BigQuery! It has the top 25 search terms and top 25 rising search terms over a 5 year window in 210 distinct locations in the US. cloud.google.com/blog/produc…

Interviewing Tip: Don't put things on your resume if you don't want to talk about them.

This has been an EXTREMELY long time coming and I'm so excited about it! The launch of this architecture means our Public Datasets Program can onboard more data of various data types and accept requests from public users! cloud.google.com/blog/topics…