Run pandas at scale directly in your data warehouse—be it Snowflake, BigQuery or DuckDB—all from the comfort of your favorite IDE or notebook.
Joined June 2021
- Tweets 682
- Following 160
- Followers 2,252
- Likes 582
138 Photos and videos
Pinned Tweet
25 May 2023
📣 As of TODAY, Ponder is in Public Beta. 🚀 Now ANYONE can start running Python data workflows (pandas, NumPy) directly in their data warehouse in less than five minutes. Just pip install ponder.
Learn more below! 🧵[1/N]
ponder.io/ponder-in-public-b…
#python #pandas #datascience
8
12
48
27,777
23 Oct 2023
We’re excited to announce Snowflake's intent to acquire Ponder to bring Ponder's Python data science innovations to all its customers.
Thank you to all of the Ponder and Modin supporters who brought us to this point -- We're excited for what's to come!
ponder.io/snowflake-to-acqui…
23 Oct 2023
Snowflake announced its intent to acquire @ponderdata to further enable Python data scientists in the Data Cloud. We look forward to welcoming the Ponder team and the Modin community to Snowflake. Learn more: okt.to/I6WXlc
3
9
56
16,223
13 Oct 2023
Great coverage in the @realpython podcast of @maheshvash's article: "Why Are There So Many Python Dataframes?"
Here's the link to jump straight to that 7-minute portion:
realpython.com/podcasts/rpp/…
Link to article: ponder.io/why-are-there-so-m…
13 Oct 2023
🐍🎧 Episode #176 of the Real Python Podcast is live: “Building Python Best Practices and Fundamental Skills” #python #podcast realpython.com/podcasts/rpp/…
2
4
8
10,736
12 Oct 2023
You can run NumPy 🔢 at scale in your database with Ponder 💥
Through @modin_project, Ponder supports:
- Element-wise matrix ops (addition, subtraction, division, power)
- Axis-collapsing or reducing ops (min, max, sum, product, mean)
& more: ponder.io/numpy-on-snowflake…
#NumPy #SQL
1
9
1,055
3 Oct 2023
If you're backed into a dark alley, facing a pack of ravenous NaN dogs, you'll want a sidekick like pandas dropna.
Drop rows with n missing values using thresh=n.
Drop entirely empty rows with how='all'.
Learn more from @__mharrison__: ponder.io/professional-panda…
#pandas #Python
2
2
12
2,161
29 Sep 2023
A 2-hour pandas workflow (150 million rows) can take 2 minutes with Ponder on Snowflake.
Read more: ponder.io/ponder-in-public-b…
Or watch the demo here: youtube.com/watch?v=N7D2Wnc5…
#pandas #SQL #Snowflake
2
6
746
26 Sep 2023
How do you use database connections & cursors in Python?
It can be hard to figure out because database concepts & Python objects don't map 1:1.
To learn more (with an emphasis on the Snowflake-Python connector) check out: ponder.io/top-5-things-to-kn…
#python #database #snowflake
1
6
687
22 Sep 2023
If you want to automatically parallelize your pandas code, you should check out open-source Modin: github.com/modin-project/mod…
@modin_project uses the pandas API, so all you need to do is change "import pandas as pd" to "import modin.pandas as pd"
#pandas #Python #opensource
1
3
9
1,145
Ponder retweeted
22 Sep 2023
How the Python Dataframe Interchange Protocol Makes Life Better
In this article, we answer three questions about the Python Dataframe Interchange Protocol: What it is what problems it solves; how it works; and how extensively it's been adopted.
ponder.io/how-the-python-dat…
1
7
19
5,351
Ponder retweeted
21 Sep 2023
We're happy to announce the release of #pandas 2.1.1. You can install it with `pip install pandas` or `mamba install -c conda-forge pandas`. You can find what's new in this version in the release notes. Thanks to all contributors and sponsors who made this release possible!
2
22
138
15,262
20 Sep 2023
Ever had hourly data, but wished it were monthly? Daily, but wished it were weekly? 😢
pandas resample will dry your tears.
It makes upsampling downsampling really slick, & now it's possible to run it directly in your database: ponder.io/how-to-use-pandas-…
#pandas #database
1
2
11
1,423
20 Sep 2023
Congratulations to @MotherDuck 🦆 on your Series B 📈
We're excited to have Ponder be part of the Modern Duck Stack!
motherduck.com/blog/motherdu…
#pandas #Python #duckdb
1
2
20
2,144
18 Sep 2023
pandas. Modin. Polars. RAPIDS cuDF. Ibis. Vaex. Dask. PySpark. Daft. Snowpark dfs. BigQuery dfs.
Why are there so many #Python #dataframe libraries?
Open-source dataframe contributor Ponder Founding Engineer @maheshvash shares 3 conclusions: ponder.io/why-are-there-so-m…
5
26
88
27,865
18 Sep 2023
Comments, questions, things to add -- Feel free to share thoughts here
2
567
14 Sep 2023
Pulling data from @SnowflakeDB to work w/ scikit-learn, LightGBM, XGBoost?
💥Snowpark ML lets you stay in Snowflake but use important ML classes: LGBMClassifier, Lasso, PCA, XGBClassifier, etc.
💥Ponder lets you do your pandas preprocessing in Snowflake
ponder.io/using-snowpark-ml-…
1
2
386
13 Sep 2023
Ponder typically runs pandas code in your database by translating it to SQL. But pandas apply is different.
For apply, we create a temporary Python user-defined table function (UDTF).
Read more about apply how Ponder handles it: ponder.io/pandas-apply-in-yo…
#Python #pandas #SQL
1
2
9
3,501
11 Sep 2023
.@IntelDevTools saw a workload speedup of 4X with @modin_project (the scalable drop-in replacement for pandas) compared to pandas!
Read more from Intel here: intel.com/content/www/us/en/…
#python #pandas #datascience
8
15
1,475
8 Sep 2023
The Python Dataframe Interchange Protocol is a quiet hero 🦸♀️.
It makes it easy for libraries to accept many dataframes (Modin, Polars, Ibis, cuDF, Dask).
Read our encomium: ponder.io/how-the-python-dat…
Thanks to Marco Gorelli & @ralfgommers for your work!
#python #dataframes
1
3
13
2,509
6 Sep 2023
Ponder, explained in 90 seconds ⏱️:
youtube.com/watch?v=YjZ5x7Ln…
#python #pandas #datascience #sql #database
2
1
7
1,334