Memory-Bound but Not Bandwidth-Limited: The Physical AI Inference...
Physical AI systems, including robots, autonomous vehicles, embodied agents and edge copilots, often run a different inference workload from cloud LLM serving: single-stream, batch-1...
arxiv.org