Great to have this repo! thanks @kwindla! Gemini 2 Voice-to-Voice = the fastest voice interface? Pipecat means fast transport. It's clearly hearing non-verbal audio but struggles to describe it, and can't sing or laugh. Great for practical apps. This repo rocks!

Gemini 2.0 launched today. Amazing multimodal capabilities, long context windows, fast response times, built-in tools, and top-of-the-leaderboards reasoning capabilities. Plus a new API — the Multimodal Live API — for conversational AI applications, like voice agents and multimodal copilots. @Google and Daily have partnered to build Multimodal Live API support into the @pipecat_ai Open Source SDKs for Web, Android, iOS and C . The Pipecat SDKs come with echo cancellation and noise reduction, device management, event abstractions, React hooks, and more. They support both direct connections to the Gemini WebSocket API, and WebRTC routing on Daily's global ultra-low latency network. Build realtime voice agents with Gemini, Pipecat, and Daily. Links to docs and starter kits in the thread below (1/4)...

Gemini 2.0 launched today. Amazing multimodal capabilities, long context windows, fast response times, built-in tools, and top-of-the-leaderboards reasoning capabilities. Plus a new API — the Multimodal Live API — for conversational AI applications, like voice agents and multimodal copilots. @Google and Daily have partnered to build Multimodal Live API support into the @pipecat_ai Open Source SDKs for Web, Android, iOS and C . The Pipecat SDKs come with echo cancellation and noise reduction, device management, event abstractions, React hooks, and more. They support both direct connections to the Gemini WebSocket API, and WebRTC routing on Daily's global ultra-low latency network. Build realtime voice agents with Gemini, Pipecat, and Daily. Links to docs and starter kits in the thread below (1/4)...

Today we’re launching Daily Bots, the ultra low latency Open Source cloud for voice, vision, and video AI. Build voice-to-voice with any LLM, at conversational latencies as low as 500ms. With Daily Bots, developers can: *️⃣  build with Open Source SDKs *️⃣  mix and match the best Generative AI models for specific use cases *️⃣  run at scale on Daily’s real-time global infrastructure We've partnered with @AnthropicAI, @cartesia, @DeepgramAI, and @togethercompute for this launch. Our goal is to combine the best tools, best developer ergonomics, and best infrastructure for real-time AI into a single platform. Daily Bots is the culmination of the last 18 months of work we've done with customers and partners, pioneering real-time and voice-to-voice AI in production. The two fastest growing Open Source real-time AI projects came out of this work: @pipecat_ai and RTVI. *️⃣  Daily Bots apps are built using the RTVI Open Source SDKs for the Web, iOS, and Android. Your Daily Bots code will run anywhere that supports the RTVI standard. (Or you can run your own infrastructure.) *️⃣  Your Daily Bots can also answer the phone. (You can buy a phone number from us with a single curl command.) *️⃣  Bring your own API Keys and use any inference provider that supports OpenAI-compatible APIs. Or run your own models and connect your bots to your infrastructure. For a highly non-serious take on the kinds of things we’ve been creating for ourselves, as we’ve worked on Daily Bots, check out the video. We'd love to hear what multi-modal, real-time AI directions are most interesting to you. We can't wait to see what you build.

Today we’re launching Daily Bots, the ultra low latency Open Source cloud for voice, vision, and video AI. Build voice-to-voice with any LLM, at conversational latencies as low as 500ms. With Daily Bots, developers can: *️⃣  build with Open Source SDKs *️⃣  mix and match the best Generative AI models for specific use cases *️⃣  run at scale on Daily’s real-time global infrastructure We've partnered with @AnthropicAI, @cartesia, @DeepgramAI, and @togethercompute for this launch. Our goal is to combine the best tools, best developer ergonomics, and best infrastructure for real-time AI into a single platform. Daily Bots is the culmination of the last 18 months of work we've done with customers and partners, pioneering real-time and voice-to-voice AI in production. The two fastest growing Open Source real-time AI projects came out of this work: @pipecat_ai and RTVI. *️⃣  Daily Bots apps are built using the RTVI Open Source SDKs for the Web, iOS, and Android. Your Daily Bots code will run anywhere that supports the RTVI standard. (Or you can run your own infrastructure.) *️⃣  Your Daily Bots can also answer the phone. (You can buy a phone number from us with a single curl command.) *️⃣  Bring your own API Keys and use any inference provider that supports OpenAI-compatible APIs. Or run your own models and connect your bots to your infrastructure. For a highly non-serious take on the kinds of things we’ve been creating for ourselves, as we’ve worked on Daily Bots, check out the video. We'd love to hear what multi-modal, real-time AI directions are most interesting to you. We can't wait to see what you build.

Thank you, everyone, for the amazing conference🌟 Speakers, sponsors, volunteers, attendees, partners, artists, MCs, program committee ♥️ You are awesome!