If you’re looking for a more up-to-date platform for objectively testing frontier AI models on clinical cases, we’ve been building this at Medical Sphere 🙂 ⚔️ Medical Arena: medicalsphere.ai/arena 📊 Benchmark: medicalsphere.ai/benchmarks We support blinded preference testing by clinician, objective benchmark reports, and free access to advanced models for verified clinicians.

There is an urgent need for objective, independent, and clinically grounded evaluation of AI models, systems, and now agents in healthcare. Unfortunately, many existing approaches still fall short. The methodologies are often fragmented, biased, hard to reproduce, and disconnected from real clinical workflows. That’s why we built Medical Sphere. We’d be happy to evaluate @EvidenceOpen, @UpToDate, or any other medical AI system if given API access. We can run our full suite transparently, publish the results objectively, and let the audience judge. We’ve built a platform, including our Medical Arena, where verified clinicians can objectively evaluate AI models and make their voices heard on real clinical performance: medicalsphere.ai/arena We’ve also built the infrastructure to transparently run a broad suite of public and proprietary benchmarks with no conflict of interest, showing where AI tools fall short, where they genuinely help clinicians, and how they perform in real workflows: medicalsphere.ai/benchmarks

Claude Fable 5 by @AnthropicAI is live on Medical Sphere 🏥🩺 Put it to test on real clinical cases, head-to-head against other frontier models. Free for verified medical professionals. Try it here: medicalsphere.ai

Claude Opus 4.8 by @AnthropicAI just landed on MedAgentBench 🏥🩺 80.3% accuracy on 300 clinical agent cases, compared to Opus 4.7 at 89.0%. Breakdown by task 👇 medicalsphere.ai/benchmarks/…

We recorded a video to show you how to use the platform 👇 - Please go to medicalsphere.ai/ - Create a free account. You only need an email address. - Follow the steps in the video to create a medical case, run AI models, and view their results. Let us know if you need any help. We’re here! 🙂

Early results for Claude Opus 4.8 and Gemini 3.5 Flash on @OpenAI's HealthBench Professional: Opus 4.8 looks essentially flat against 4.7 (within noise). Gemini 3.5 Flash is a step up from 3.1 Pro.

Claude Opus 4.8 by @AnthropicAI is now live on Medical Sphere! 🏥🩺 Come test it on medical and clinical cases and see how it performs against other leading AI models. Try it here: medicalsphere.ai/arena

We added AI analysis cost breakdowns to Medical Sphere 🏥📊 Users can now see not only how frontier AI models perform on medical cases, but also token usage, inference costs, and the cost of AI council summaries. In healthcare, accuracy and reliability come first. As AI systems move toward real-world deployment, transparency into the infrastructure behind them matters too.

Gemini 3.5 Flash now live on Medical Sphere! 🚀

Meet @AskMedSphere, our medical AI evaluation agent on X 🏥🤖🩺 Tag it on any medical post to compare responses from frontier AI models 👇

HealthBench Professional is now live on Medical Sphere 🏥 Built by @OpenAI, this benchmark contains 525 real clinician chat cases across care consults, medical documentation, and medical research. medicalsphere.ai/benchmarks

The full evaluation pipeline including all evaluation scenarios, scoring, and analysis notebooks is also available on GitHub. github.com/medicalsphere/nej…

NEJM-Bench, 20 years of clinical image cases from the New England Journal of Medicine Image Challenges, is now available on 🤗 HuggingFace. huggingface.co/datasets/medi…