Meta AR Research

Joined June 2009
147 Photos and videos
MingfeiYan retweeted
Introducing Depth Estimation with NVIDIA’s FoundationStereo—a new open tutorial and codebase for metric depth sensing using Project Aria Gen 2 devices. ⚡️ Real-time ready (20 FPS) 🤖 Zero-shot generalization ⚡️Stereo image rectification and disparity estimation 🔓 Open Source Check out the code and tutorial: github.com/facebookresearch/… 🔌@the_shweenz
7
31
223
32,615
MingfeiYan retweeted
Meta and Project Aria are headed to Denver for CVPR 2026. ✈️ The Project Aria team will be onsite, highlighting the latest from our program on the future of Contextual AI and Robotics research! 🤖 📍 Denver, Colorado 📅 June 3–7, 2026 🤝Booth 201 We'll see you tomorrow for presentations on the cutting edge of computer vision research across CVPR's workshops and tutorials. See our snapshot agenda below for details!
2
2
27
1,985
MingfeiYan retweeted
May 28
Introducing Claude Opus 4.8: it builds on Opus 4.7 with sharper judgment, more honesty about its own progress, and the ability to work independently for longer than its predecessors. Available today at the same price.
3,688
8,627
67,442
15,236,145
MingfeiYan retweeted
How do we train AI to be a real-world expert? 🛠️🧠 Introducing Ego-EXTRA, a new video-language dataset for Expert-Trainee assistance. Researchers at the University of Catania captured unscripted interactions where experts guide trainees through complex tasks in real-time using Aria Glasses. 👓 50 hours of data 💬 15k high-quality VQA sets ✅ RGB Eye Gaze tracking ✅ Hand keypoints & SLAM ✅ IMU, Magnetometer, & Audio ✅ Natural expert-trainee dialogue 🚲 4 scenarios: Bike Workshop, Kitchen, Bakery, & Assembly Explore the benchmark: fpv-iplab.github.io/Ego-EXTR… Read the paper: arxiv.org/abs/2512.13238 👉@FrancRagusa, @GMFarinella
2
15
96
7,963
MingfeiYan retweeted
Apr 17
Introducing Claude Design by Anthropic Labs: make prototypes, slides, and one-pagers by talking to Claude. Powered by Claude Opus 4.7, our most capable vision model. Available in research preview on the Pro, Max, Team, and Enterprise plans, rolling out throughout the day.
4,141
14,999
148,136
63,895,513
MingfeiYan retweeted
Introducing Project Glasswing: an urgent initiative to help secure the world’s most critical software. It’s powered by our newest frontier model, Claude Mythos Preview, which can find software vulnerabilities better than all but the most skilled humans. anthropic.com/glasswing
1,985
6,645
44,009
31,424,979
MingfeiYan retweeted
Today, we’re releasing a feature that allows Claude to control your computer: Mouse, keyboard, and screen, giving it the ability to use any app. I believe this is especially useful if used with Dispatch, which allows you to remotely control Claude on your computer while you’re away.
901
1,463
18,618
4,783,052
MingfeiYan retweeted
Introducing EgoVerse: an ecosystem for robot learning from egocentric human data. Built and tested by 4 research labs 3 industry partners, EgoVerse enables both science and scaling 1300 hrs, 240 scenes, 2000 tasks, and growing Dataset design, findings, and ecosystem 🧵
34
163
882
268,421
MingfeiYan retweeted
#NVIDIA just released a whole ecosystem for human(oid) motion and robot learning from human data. 🚀🦾 Data, as we all know, is the key to scaling AI models. To accelerate the field of Embodied AI, we have open-sourced a full stack of models and tools to capture, generate, retarget, and simulate human(oid) motion data at scale, along with a massive high-quality dataset and a standard human skeletal representation, SOMA, to make them all seamlessly communicate with each other. The entire suite is available under the Apache 2.0 license. 1️⃣ SOMA: A universal interface to unify all parametric human body models (SOMA-shape, SMPL, MHR, etc.) into a standard skeletal representation, eliminating the need for custom adapters or model-specific retargeting. 🔗 lnkd.in/gsxhiJnn 2️⃣ Kimodo: High-fidelity, controllable text-to-motion generation for both humans and humanoid robots. 🔗 lnkd.in/gCc84XnX 3️⃣ GEM: A global human pose estimation method from in-the-wild videos, natively compatible with SOMA. 🔗 lnkd.in/g_QAvRjn 4️⃣ Bones-SEED: A massive dataset of 150k motions in SOMA format, including data already retargeted for the Unitree G1, created with our partners at Bones Studio. 🔗 lnkd.in/gfx-QD-w 🔗 lnkd.in/gyNdTwQx 5️⃣ SOMA Retargeter: A dedicated tool for seamless motion retargeting from the SOMA skeleton to the Unitree G1. 🔗 lnkd.in/gqz9Na-H 6️⃣ ProtoMotions: Our high-performance simulation framework for training digital human(oid)s via RL, now with native SOMA support. 🔗 lnkd.in/gmvMikMU This is just the beginning, and we have much more in the pipeline. Excited to see what the community builds next! #NVIDIA #GTC #GTC2026 #Robotics #EmbodiedAI #PhysicalAI @NVIDIAAI
5
80
426
46,863
MingfeiYan retweeted
Mar 11
TIME’s new cover: How Anthropic found itself in an existential fight over the future of war time.com/article/2026/03/11/…
70
418
1,265
552,277
MingfeiYan retweeted
Claude Code Remote is rolling out now for Pro users
Rolling out Claude Code Remote Control to Pro users - because they deserve to use the bathroom too . (Team and Enterprise coming soon). 🧻 Rolling out to 10% and ramping 1. Update to claude v2.1.58 2. Try log-out and log-in to get fresh flag values. 3. /remote-control
195
153
3,451
298,776
MingfeiYan retweeted
Claude is #1 in the App Store today — I want to say a huge thank you to all of our new (and existing!) users for the support. We’re working hard for you, please share your thoughts and feedback along the way.
265
480
6,340
421,901
MingfeiYan retweeted
A statement from Anthropic CEO, Dario Amodei, on our discussions with the Department of War. anthropic.com/news/statement…
4,240
9,210
55,540
16,673,648
MingfeiYan retweeted
Meta released ShapeR Generates metric 3D shapes from casual captures using SLAM points, multi-view images & text captions. 2.7x better Chamfer distance than SOTA on a new benchmark with 178 in-the-wild objects.
1
44
371
19,994
MingfeiYan retweeted
20 Oct 2025
egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Tasks. Talk in: Project Aria Research Tutorial ICCV'25 poster: Tuesday arXiv: arxiv.org/abs/2502.20879 code dataset: github.com/eth-siplab/egoPPG project: siplab.org/projects/egoPPG
2
1
266
20 Oct 2025
Project Aria’s mission is to bring the human perspective to AI. Today marks another important milestone - Aria Gen 2 applications are now open to academic and corporate research partners! See our blog post on the Meta blog for more detail. We've also released the brand new Aria Gen 2 Pilot Dataset, which gives a glimpse of what the glasses are capable of producing. Please enjoy learning more about Aria Gen 2 and submit a detailed application when ready. And talk to us at #ICCV2025 if you're here. See links below! Blog Post: lnkd.in/gW9SNBqC Device White Paper: lnkd.in/gyS8S5-b Dataset Page: lnkd.in/gACCVeJY Research Kit Page for Applications: lnkd.in/gvKhqass Documentation: lnkd.in/gmtjUrff
43
MingfeiYan retweeted
Join the Project Aria Team at "Benchmarking Egocentric Visual-Inertial SLAM at City Scale" in room 325B. 📅TODAY! Sunday, Oct. 19 ⏰ 1pm-5pm 🔗 Agenda: lamaria.ethz.ch/tutorial 🚨Opening remarks @ 1pm from @jajuengel, @mapo1, and David Caruso. Learn more about how Project Aria's MPS SLAM Aria Gen 1 glasses enabled the LaMAria dataset - a city-scale egocentric dataset to track progress in egocentric VIO/SLAM.
2
5
978
MingfeiYan retweeted
The Project Aria Team is excited for The Fourth Hands-on Egocentric Research Tutorial with Project Aria 😎 TOMORROW Monday, Oct 20th 📅Monday, Oct 20th 🕐8am-12pm 📍NOW IN in room 328 Featuring inspiring talks from @rapideRobot, @LingniMa, @danfei_xu, @bowenwen_me and more! 🔗 Check out the full agenda projectaria.com/project_aria… #ICCV2025 #ProjectAria #Meta
2
3
434
MingfeiYan retweeted
Join the Project Aria team at #ICCV2025 for The Fourth Hands-on Egocentric Research Tutorial with Project Aria 😎 📅Monday, Oct 20th 🕘8am-12pm 📍Room 326B Featuring inspiring talks from @rapideRobot, @LingniMa, @danfei_xu, @bowenwen_me, and more! 🔗 Learn more projectaria.com/project_aria… #ICCV2025 #ProjectAria #Meta
3
10
23
9,321