Introducing C.A.R.E, Rosebud's open-source approach to AI safety & self-harm. Read more below 👇
We tested 21 AI models on 5 self-harm scenarios. The results were sobering.
When we saw the recent news involving AI chatbots and teen suicides, we became deeply concerned. As LLMs are proliferating through every piece of software in the world, how can developers know the models they’re using are safe?
We have public benchmarks for AI reasoning, math, and legal capabilities, but not for one of the highest-stakes interactions an AI can have with a human, so we decided to build one.
Introducing CARE, our initial evaluation framework. Think of this as v0.1. We're making it public and inviting researchers, safety experts, and developers to help us build something truly comprehensive because this problem is too important to solve behind closed doors. We need an objective measure for public visibility.
If you’re interested in contributing to the effort, we’d love to hear from you.