Data Nerds! I ranked every data engineering tool by how often it shows up in 4M job postings. 📊 But here's the catch 😳. Some critical skills show up way less than they should because they're often assumed to be foundational skills for jobs. (e.g., Skills like Bash/Terminal for running pipelines) Anyway, here's the breakdown of the tiers 👇 (Note: % = how often each tool appears in DE job postings) 🔴 S TIER — Non-Negotiable The core skills needed for any DE job. Don't apply without these: 📊 SQL (~68%) — every warehouse runs on it. Query, transform, and model data. 🐍 Python (~67%) — the pipeline language. Ingestion, automation, APIs, glue between systems. ⌨️ Terminal/Bash (~11%) — every tool you'll use runs from here. This is highly undervalued in postings. 📁 Git (~11%) — version control. Every team uses it. Same posting-% caveat as Bash. ☁️ One cloud platform warehouse (~26-46%) — AWS Redshift, GCP BigQuery, or Azure Synapse. Combined cloud presence is in nearly every posting. Start with SQL, then Python. Everything else you absorb alongside them. 🟠 A TIER — Job-Ready Foundation The tool that closes the gap from "learning DE" to "hireable for modern stacks": 🪛 dbt (~10%) — only 10% of all DE postings, but 36% in Analytics Engineer (AE) roles. That's not a niche, it's a leading indicator. AE is the new hybrid role modern data teams are hiring for: part analyst, part engineer. ✅ Land the job with S A. Pass the interview with conceptual knowledge of B Tier 👇 🟡 B TIER — Interview-Aware Know what they solve. Don't expect to code from scratch: ⚙️ Airflow (~17%) — orchestration. Built on DAGs (directed acyclic graphs). ⚡ Spark (~38%) — distributed computing for processing large datasets. 🌊 Kafka (~19%) — real-time event streaming between systems. All these depend on a foundational knowledge of Python & SQL; don't jump the gun learning these. 🟢 C TIER — Data Platform Awareness Pick the one your company uses. Understand both conceptually: ❄️ Snowflake (~26%) — pure SQL warehouse. Optimized for analytics. Modern-stack favorite. 🧱 Databricks (~24%) — lakehouse on Spark. Handles structured unstructured. ML/AI heavy teams. 🔵 D TIER — Versatility Multipliers Lower headline demand, but high value per hour: 📊 Power BI (~15%) / Tableau (~10%) — but the kicker: in AE roles these jump to 28% / 33%. Modern data teams want pipeline builders who can also visualize. For analysts pivoting to DE, lead with this in interviews. 🟣 E TIER — Path-Dependent High demand on paper, but concentrated in legacy enterprise stacks. Skip until your job requires it: ☕ Java (~25%) — legacy enterprise data infrastructure ⚖️ Scala (~22%) — Spark's native language. Spark-heavy shops. 🎥 How did I derive this ranking? In my latest video, I walk through the concepts first (the DE lifecycle, what each tool actually solves) and then derive the tiers. (Link in comments 👇)

Data Nerds! I just launched a FREE 10-Day Crash Course on Becoming a Data Engineer! 🛠️ This course is for the analyst whose boss heard 'I know SQL' and somehow translated that to 'build our entire data infrastructure.' 😵 Over the course of 10 days, I'll deliver it straight to your inbox, one email at a time: 🧑‍💻 Day 1: What Data Engineers actually do 🔄 Day 2: The Data Engineering Lifecycle — the framework everything clicks around 🛠️ Day 3: Essential DE tools — backed by real job posting data 🏗️ Day 4: Data warehouses, lakes, and lakehouses 📐 Day 5: Data modeling — the skill that separates analysts from engineers 📥 Day 6: Batch vs. streaming ingestion 🔧 Day 7: ETL, ELT, and transformations 📊 Day 8: Serving data to the business ⚙️ Day 9: Orchestration and production pipelines 🗺️ Day 10: Your DE learning roadmap 🎁 Bonus: How to land your data job It's the crash course I wish I had back when I was nodding along to words like 'orchestration' and 'ingestion' and praying nobody asked me to define them. 😅 No fluff. No tool-of-the-week hype. Just the concepts that make the rest of it click. 📩 Link in the first comment 👇

Data Nerds! I just launched a free course on "SQL for Data Engineering!" This is the course I wish I had when I stopped asking “how do I query this?” and started asking “how do I build this?” 🏗 This YouTube video has over 14 hours of content and walks through building a real data warehouse and production-ready SQL pipeline from scratch. We go far beyond SELECT statements: 1️⃣ Production SQL — DDL, DML, CTEs, subqueries, window functions, and advanced query patterns 2️⃣ Data Modeling — Designing star schemas and analytics-ready warehouse tables 3️⃣ Data Warehousing — Structuring fact and dimension tables properly 4️⃣ End-to-End Pipelines — Transforming raw data into clean, production-ready outputs 5️⃣ Engineering Workflow — Using Terminal, DuckDB, VS Code, and Git And because the best way to learn is to build, we complete two real projects: 📊 Project #1 — Exploratory Data Analysis on a live warehouse dataset 🏗 Project #2 — Build a full SQL-based data pipeline Huge thank you to the team that made this possible: Kelly Adams - Course Producer Rikki Singh - Content Developer Brannon Linder - Video Editor P.S. If you’re wondering how this compares to my SQL for Data Analytics course: That course focuses on querying data to answer business questions. This one focuses on modeling data, designing warehouse schemas, writing production-grade SQL, and building end-to-end pipelines using the Terminal and Git. 🧑‍💻 Analytics is about extracting insights. 🧑‍🔧 Engineering is about building the systems that make those insights possible. Neither course is a prerequisite, but they prepare you for different roles.

Data Nerds! I just launched a free course on "Power BI for Data Analytics!" This course is for anyone who has ever been stuck emailing 'final_v3_final_FINAL.xlsx'. 🥵 It's the guide I wish I had when learning how to build a real, end-to-end analytics solution, packed with all my professional tips and tricks on a live dataset. 🪄🐰 We cover the entire Power BI workflow across four key chapters: 1️⃣ Grand Tour: A deep dive into Power BI Desktop & Service. 2️⃣ Visualizations: Mastering charts, maps, cards, and design. 3️⃣ Power Query: For all your data cleaning & transformation (ETL). 4️⃣ DAX & Modeling: Write powerful formulas on a solid data model. And since the best way to learn is by building, we'll apply these skills to create two portfolio-ready dashboards! 📊 Project #1: Data Jobs Dashboard (with Drill-Through) 📈 Project #2: The Final Dashboard (Single-Page Focus) P.S. This course was a beast to build, but I'm so stoked it's finally here!

Data Nerds! I just launched a FREE 5-Day Crash Course on Becoming a Data Analyst! 🤓 Breaking into data can feel overwhelming—too many skills, too many paths, and the classic “How do I get experience without a job?” dilemma. 😵‍💫 That’s why I built this step-by-step course to cut through the noise and get you job-ready, fast. Each day, we tackle a key challenge on your path to becoming a Data Analyst: 😨 Day 1 - Overcoming the Biggest Fears About Breaking Into Data 🧑‍💻 Day 2 - What Data Analysts Actually Do (And Common Myths) 🛠 Day 3 - The First Technical Skills You MUST Learn 🧠 Day 4 - 3 Secrets to Accelerate Your Learning 🗺️ Day 5 - My 3-Step Roadmap to Stand Out With Employers It's completely free and sent straight to your inbox—because getting started in data shouldn't feel like guesswork.

Data Nerds! I just launched a free course on “Python for Data Analytics!" This is the tutorial I wish I would have had when first learning how to code This YouTube video has over 11 hours of video content, and I couldn't have done it without the help of @KellyjAdamz!  🙌 Here are some course highlights: 💻 Python Environment and Full Data Access 📚 Top Libraries Covered: Matplotlib, Pandas and Seaborn 👨🏼‍💻 All Code Publicly Available in my GitHub Repo And the best way to LEARN something is to BUILD something; So we’ll also tackle a real-world problem for our final capstone project: 📺 Walkthrough of a Fully Customizable Project 📊 Access to Data Science Job Insights 👾 Shareable Project to Host on GitHub P.S. Sorry for the delay in content over the past couple of months, as this has been taking up all my bandwidth, and there is no way I could have done it without Kelly’s help!