If you're attending @databricks Data AI Summit in #SF (June 10-13), make sure to stop by the Expo Hall on Wed to watch our Co-Founder & CEO, Max Snow, give his lightning talk (with demo) on "How Private Data 🧠 Will Transform Generative AI!" 🤖 #DataAISummit

Significant progress in AI and Robotics this week. Big developments from Etched, Runway, Figure, NVIDIA, OpenAI, Anthropic, Microsoft, Boston Dynamics, ElevenLabs, Osmo, Physical Intelligence, Meta, and more. Here's everything you need to know and how to make sense out of it:

Databricks VP of AI @NaveenGRao shares what it takes to transition from engineering to entrepreneurship in this conversation with Walter Thompson on the Fund/Build/Scale Podcast. Listen here: dbricks.co/48v0yWk

Our data shows that vector database usage is on the rise. There's a clear trend: companies are turning to RAG instead of relying on stand-alone LLMs. Explore these insights and more in the latest State of Data AI report! bit.ly/45Q2jvW

Hybrid search in #MosaicAI Vector Search is now GA! This powerful feature combines the strength of pre-trained embedding models with keyword search flexibility. Explore how it works and how to use it to improve your search results: bit.ly/4732QLO

For how long should you train your language model? How large should your model be? Research from @DbrxMosaicAI proposes a modified scaling law that quantifies the training-inference trade-off – producing models that are optimal over their total lifetime. dbricks.co/3zSwPJX

Discover how ethical data is empowering businesses to thrive with AI in the latest episode of “Candid Communications with Silvia Candiani.” Join guest Max Snow, @YobiAI CEO, to explore AI transformation in media, marketing & beyond: msft.it/6019ldK3U #AI #Data #Marketing

With nearly 16K attendees and an amazing line-up of keynote speakers, this year’s #DataAISummit featured a variety of product announcements, innovations, & insights. Check out this recap of the Executive Forum talks and the newest Databricks innovations! dbricks.co/3zmyC9M

Pumped to announce the brand new open LLM leaderboard. We burned 300 H100 to re-run new evaluations like MMLU-pro for all major open LLMs! Some learning: - Qwen 72B is the king and Chinese open models are dominating overall - Previous evaluations have become too easy for recent models, much like grading high school students on middle school problems - There are indications that AI builders have started to focus on the main evaluations too much at the expense of model performances on other ones - Bigger is not always smarter Really excited about how the field is maturing on evaluation, let's go!

Today we’re announcing Meta LLM Compiler, a family of models built on Meta Code Llama with additional code optimization and compiler capabilities. These models can emulate the compiler, predict optimal passes for code size, and disassemble code. They can be fine-tuned for new optimizations and compiler tasks. @HuggingFace repo ➡️ go.fb.me/tdd3dw Research paper ➡️ go.fb.me/85zwgy LLM Compiler achieves state-of-the-art results on code size optimization and disassembly. This work shows that AI is learning to optimize code and can assist compiler experts in identifying opportunities to apply optimizations. We’re releasing LLM Compiler 7B & 13B models under a permissive license for both research and commercial use in the hopes of making it easier for developers and researchers alike to leverage this in their work and carry forward new research in this space.

New research thread just dropped 🧵!

Our data shows that organizations became 3x more efficient at putting #ML models into production in just 14 months 💪 You can get more production ML insights like this in the State of Data AI, which shares trends based on our 10,000 global customers: dbricks.co/45hVhQu

At #DataAISummit, we announced several new Databricks Mosaic AI capabilities to build better production-quality AI systems. These advancements simplify agent & RAG development, model fine-tuning, AI evaluation, tools governance, & more. dbricks.co/3KGilip

We’re excited to share that Jensen Huang, Founder and CEO of @nvidia, will join the #DataAISummit keynote for a fireside chat with our Co-founder and CEO, @alighodsi on the future of AI and what’s next in #GenAI. databricks.com/dataaisummit

Who is coming to @databricks Data AI Summit in #SF in 2 weeks? 🌁 My Co-Founder & CEO, Max Snow, is giving a lightning talk on "How Private #Data 🧠 Will Transform #GenAI 🤖" and we're already oversubscribed. 🔥 #DataAISummit. 🚀

A new era is coming. Find out what’s next on Monday 5/20.

Great work from @DbrxMosaicAI Research: CommonCanvas, a set of open diffusion models trained using only CC-licensed images. Comparable performance to Stable Diffusion 2 with < 3% of the amount of training data a fraction of the training cost! huggingface.co/common-canvas

#AI is used in different industries — it’s the future of data management platforms. The Databricks Data intelligence platform uses AI to tackle challenges, providing intelligent, simple to use, private, and secure solutions. ✨🤖 bit.ly/3JTh1IN

We are excited to announce the release of Delta Lake 3.2.0! 🎉 This release includes several exciting new features and improvements. View the full release notes for more info 👉 github.com/delta-io/delta/re… #opensource #deltalake