Washing dishes is at the frontier of what robots can manage. Our system needs to handle stacked plates, silverware, sideways cups and much more.
Our approach is unique and extremely effective:
1. Vision: our system can detect highly accurate 6-dof poses of dishes despite heavy occlusion, enabling precise manipulation
2. Hardware: We’ve designed fingers that handle specific dishes in various situations, and the robot can automatically change them
3. Planning: A high-level policy chooses the next goal (next dish to rinse/rack/stack, rack to move, time to run dishwasher, fingers to use) and a low-level policy builds a sequence of actions to accomplish it.