Our system ServerlessLLM got accepted into
#OSDI24! This system features a new LLM checkpoint format, multi-tier LLM loader, inference live migration, and more! This work is led by Yao Fu. Joint with Leyang, Yeqi, Andrei,
@DmitriiUstiugov, and Yuvraj. Congratulations on the team!