🚀 Building your first data pipeline? Start small, but plan for growth. 🛠️ Data evolves—build for change. 🚮 Standardize early to reduce tech debt. 🔭 Prioritize observability and quality checks. In this article, @DagWorks co-founder @stefkrawczyk breaks it down for you. hubs.ly/Q03jX4Hb0

Data pipelines have been around but they’re becoming increasingly crucial as organizations look to deploy AI agents. We spoke with @DagWorks co-founder @stefkrawczyk to understand what teams should consider when standing up their first data pipeline. hubs.ly/Q03hSzVn0

Check out the latest article in my newsletter: February Updates linkedin.com/pulse/february-… via @LinkedIn @hamilton_os: - crosses 2K⭐️ - installs in @pyodide envs - mutlithreaded parallel DAG execution @burr_framework: - crosses 1.5K ⭐️ - async persister implementations - tag aliases for actions

📣 New blog post! Chat with your webpage with @scrapegraphai, @burr_framework and @lancedb blog.dagworks.io/p/chat-with… TL;DR: a great post showing the use of lightweight tools that are "orchestrated" and "observed" with Burr.

💬Chat with your webpage cookbook is out! 💬 It uses @scrapegraphai to extract the webpage content, @lancedb to vector store it and retrieve the most relevant chunks and @DagWorks @burr_framework to orchestrate everything 🚀 Try it out: colab.research.google.com/dr…

Excited to show the pluggability of #Burr here: - execution can be farmed out to @raydistributed - persistence is pluggable and means you can have fine grained fault tolerance!

Great work by @elijahbenizzy here. Excited to explain a little more on how Burr is different than other frameworks!

Super excited for this HOW-TO on running the Hamilton UI on @SnowflakeDB : "Observability of Python Code and Application Logic with @hamilton_os UI on @SnowflakeDB Containers" Services by Greg Przemyslaw Kantyka link.medium.com/FIwGhJqzsPb

Tired of the deployment headaches with #LLM agents? #BentoML takes care of the heavy lifting - from REST endpoints to scaling. Great post by Thierry Jean from @DagWorks showing how to combine #Burr and BentoML for streamlined agent deployment! Read the blog post to learn more: blog.dagworks.io/p/burr-bent…

🎓 Learn to Test and Improve Your LLM Applications 🤖 LLM-powered apps are everywhere, but building reliable ones? That’s still a challenge. If you’ve ever wondered how to systematically test, evaluate, and improve your generative AI applications, this free 30-minute Lightning Lesson is for you. I’ll be teaching this session alongside @stefkrawczyk, co-founder of DAGWorks and an expert in building robust ML systems. Together, we’ll cover practical strategies to help you confidently test and refine your LLM apps. 📅 When: Monday, December 16, 2024 ⏰ Time: 7:00 PM EST 📍 Where: Virtual (Zoom) 💡 What You’ll Learn: •How to write pytest cases to test LLM outputs. •Building a framework for iterative improvement. •Techniques to evaluate outputs and improve stability. ✅ Register here: maven.com/p/a6f9bf/mastering… Let’s move beyond demoware and start building applications that work in production 🚀

Check out the latest article in my newsletter - highlights: @hamilton_os: - async @datadoghq tracer for async Hamilton - @pandas_dev @DataPolars with_columns support @burr_framework: - Persistence configurability for parallelism. See more here: linkedin.com/pulse/week-dece… via @LinkedIn

Super excited to be doing a @MavenHQ ⚡️ class with @hugobowne next week: "Building with #GenAI from First Principles". If you're struggling to get out of POC purgatory, or want to better understand how to develop #GenAI software, then what we're going to be talking about is for you! It's a free class - sign up here - maven.com/p/38a781/building-… (It's a sneak peek of our course that starts in January.)

Don’t miss episode 22 of Generationship! Elijah Ben Izzy (@elijahbenizzy), CTO of @DagWorks, shares his journey in AI and the exciting projects he’s leading to revolutionize data pipelines. Tune in now! hubs.ly/Q02T9Pq20

Woo Hamilton Star in the wild (yes I'm an @OpenLineage producer). #dataforai #meetup

Excited to be running a course on @MavenHQ with @hugobowne around building GenAI products using "first principles". But the course material isn't set yet. We'd love your feedback please! If you can spare a few minutes, we'd love your input here - maven.com/forms/b83ce4 #genai #llmops #genaiops #SoftwareEngineering

Diving into OSS is a blast and super important! Lately, I've been all about @burr_framework for whipping up state machines and AI agents. Just dropped my first commit in the new release 🎉 Give BURR a look guys, it plays nice with any framework. AI devs, you'll love it! #OpenSource #AI

In Episode 22 of Generationship, @RachelChalmers chats with Elijah Ben Izzy (@elijahbenizzy) of @DagWorks about Burr (@burr_framework), a tool that’s revolutionizing AI workflows. Tune in! hubs.ly/Q02T9RF40

New blog post on #Burr: TL;DR: a quick overview of Burr's features to help curate your data for review and use by your internal team: 1. Review & annotate 2. React 3. Retune blog.dagworks.io/p/annotatin…

Guess who is on the #instructor blog? ME! The TLDR: - Use #burr and #instructor to ship more quickly - Instructor for structuring LLM interactions - Burr for app structure & observability In this example we create flashcards from @YouTube videos. python.useinstructor.com/blo…

🎉 Excited to announce that @sh_reya has joined us @DagWorks as an advisor. Her research & what we're building with @hamilton_os & @burr_framework overlaps. I'm excited to work together more closely. For more see my update: new features, docs, video etc linkedin.com/pulse/week-octo…