Data engineering has a DevOps problem.
We’ve spent a decade building increasingly sophisticated pipelines on top of operational practices that haven’t meaningfully evolved since cron jobs and shared notebooks.
Next week at 𝗗𝗲𝘃𝗢𝗽𝘀 𝗣𝗿𝗼 𝗘𝘂𝗿𝗼𝗽𝗲 in Vilnius (May 19–22), I’m taking the stage to make the case that the gap between software engineering rigour and data engineering practice is the single biggest reason data platforms underdeliver, and what we can do about it.
𝗧𝗮𝗹𝗸: CI/CD for Data Pipelines — Bringing DevOps Excellence to Data Engineering
We’ll cover the principles, the patterns, and the painful lessons from production. No vendor pitches. No hand-waving. Just the operating model that separates teams shipping reliable data products from teams firefighting at 2am.
If you’re attending, let’s connect. I’m always up for a conversation about where data infrastructure is heading next.
#DevOpsProEurope#DataEngineering#PlatformEngineerin
Heading to #DevOpsProEurope in Vilnius next week! Catch my talk on cost-effective #Serverless Development on Fri afternoon & join the panel on #AIinSoftwareDev in the morning. Excited to meet everyone in my hometown! 🇱🇹
Yes, just finished my presentation recording for #DevOpsProEurope! In this one I talk through using AWS Lambda and URL Functions for ML inference on #serverless. So cool, so simple!
ALT Register for DevOps Pro Europe 2022 arriving 24-26 May https://bit.ly/35fXlNV.
Join @DevOpsEU to cover the principles of DevOps methodology #ad #DevOpsProConferenceEurope
#DevOps #software #agile #developers #coding #cloudcomputing #tech
Conference staff recorded sessions at DevOps Pro Europe 2021. If you were a registered attendee and you’d like to watch/re-watch sessions (including mine!), contact conference organizers for private links to the videos. #DevOps#DevOpsProEurope#Team#Leadership#Speaker#PMOT
Conference staff recorded sessions at DevOps Pro Europe 2021. If you were a registered attendee and you’d like to watch/re-watch sessions (including mine!), conference organizers will provide private links to the videos. #DevOps#DevOpsProEurope#Team#Leadership#Speaker#PMOT
Sessions at DevOps Pro Europe 2021 were recorded by conference staff. If you’d like to watch/re-watch sessions (including mine!), conference organizers will provide registered attendees with private links to the videos. #DevOps#DevOpsProEurope#Team#Leadership#Speaker#PMOT
Sessions at DevOps Pro Europe 2021 were recorded by conference staff. In case you’d like to watch/re-watch sessions (including mine!), conference organizers will be providing registered attendees with private links to the videos. #DevOpsProEurope#Team#Leadership#Speaker#PMOT
Sessions at DevOps Pro Europe 2021 were recorded by conference staff. In case you’d like to play/replay sessions (including mine!), conference organizers will soon be providing registered attendees with private links to videos. #DevOpsProEurope#Team#Leadership#Speaker#PMOT