@Jackfram2 profile picture
Zhihao Zhang @Jackfram2
Joined May 2019
  • Tweets 39
  • Following 150
  • Followers 34
Photos and videos
RT @ruihanglai: Two moments every ML researcher knows. You get onto a new cluster, and week one goes to fitting the framework to your setup…
10
2
Zhihao Zhang retweeted
Yixin Dong@yi_xin_dong
May 27
Excited to share XGrammar-2 has been accepted by #ACMCAIS 2026 @CAISconf! 🎉 ⚡️ Up to 80x speedup 🛡️ Strict tool-calling correctness 🚀 Trusted by xAI in production systems Join our presentation today at 4 PM at Bayshore Ballroom to see how we power critical agent workloads at scale. 🔗Blog: blog.mlc.ai/2026/05/04/xgram… 🔗GitHub: github.com/mlc-ai/xgrammar

Yixin Dong@yi_xin_dong
May 4
Introducing XGrammar-2: structured generation for complex agent harnesses. Strict tool-calling formats. Built-in DeepSeek-V4 and Qwen-3.6 support. Up to 80x speedup over XGrammar. Ready-to-use integrations with vLLM, SGLang, TensorRT-LLM, and more! ⚡ From Claude Code to OpenClaw, agents are defining more complex harnesses. XGrammar-2 ensures LLMs always interact with them in the right way. Built in collaboration with DeepSeek, Databricks, and leading frontier AI labs to bring XGrammar-2 into latest models and products. 🧩 Structural Tag: one unified abstraction to describe any format your agent needs 🚀 Scales to 500 strictly typed tools for complex agent harnesses 🌐 Native APIs in Python, C , Rust, and JS, running everywhere from cloud to edge 🛠️ Integrated with vLLM, SGLang, TensorRT-LLM, and more Excited to see what agent builders create with it! Blog: blog.mlc.ai/2026/05/04/xgram… GitHub: github.com/mlc-ai/xgrammar
1
12
39
4,088
Zhihao Zhang retweeted
Hongyi Jin@HongyiJin258
May 22
Had a blast presenting Event Tensor at MLSys2026! 🚀 TL;DR: We make writing dynamic megakernels simple. ⚡ Thanks to my advisors & collaborators. Here’s pic from yesterday’s poster session 👇 Let’s chat! 🔗 arxiv.org/abs/2604.13327
2
13
54
18,643
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
May 21
Today’s #MLSys2026 keynote featured @LukeZettlemoyer on rethinking the data and architecture behind pretraining: an exciting look at how the foundations of modern AI are evolving. Thrilled to see 1,100 attendees joining MLSys this year!
7
43
3,436
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
May 15
🚀Introducing Motus Tracing: open-source observability for AI agents. Without traces, an agent is a black box that burns tokens. Yet most agent observability and tracing stacks today live behind accounts and subscription tiers. Motus Tracing is fully open source. Capture every model call, tool call, sandbox interaction, sub-agent action, retry, and error, for any agent framework. One unified interface from development to production. Same spans for debugging, evals, and Learning Agents. Blog: lithosai.com/blog/motus-agen… Code: github.com/lithos-ai/motus @lithos_ai
0:19
14
51
355
28,398
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
May 8
🚀 Introducing Learning Agents in Motus Cloud. Instead of manually tuning prompts, tools, models, and reasoning flows, Motus continuously optimizes deployed agents from real production traffic by building eval sets, proposing better versions, and surfacing the Pareto frontier across quality and cost. Public preview, tokens on us👇 lithosai.com/blog/learning-a… @lithos_ai
0:15
1
12
35
4,525
Zhihao Zhang retweeted
Lijie(Derrick) Yang
@LijieyYang
May 1
Excited to share that LessIsMore has been accepted to ICML 2026! 🚀 LessIsMore is a training-free sparse attention for efficient long-horizon reasoning. By enforcing cross-head unified token selection, it brings up to 1.6x E2E speedup while preserving reasoning accuracy under practical workloads. Huge thanks to my amazing co-authors and mentors @Jackfram2, @JiaZhihao, Ravi! Paper: arxiv.org/abs/2508.07101 Code: github.com/DerrickYLJ/LessIs… #ICML2026 #LLM #EfficientAI
8
22
75
9,117
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
May 1
Congrats to @LijieyYang and the team! 🚀 Excited to see LessIsMore at #ICML2026 — a simple, training-free sparse attention approach for faster long-horizon reasoning.
Lijie(Derrick) Yang
@LijieyYang
May 1
Excited to share that LessIsMore has been accepted to ICML 2026! 🚀 LessIsMore is a training-free sparse attention for efficient long-horizon reasoning. By enforcing cross-head unified token selection, it brings up to 1.6x E2E speedup while preserving reasoning accuracy under practical workloads. Huge thanks to my amazing co-authors and mentors @Jackfram2, @JiaZhihao, Ravi! Paper: arxiv.org/abs/2508.07101 Code: github.com/DerrickYLJ/LessIs… #ICML2026 #LLM #EfficientAI
1
7
38
3,760
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
Apr 14
🚀Introducing Motus, the open-source agent infrastructure that learns in production. Existing agent infra serves static agents: the harness, model, and workflow are fixed after deployment. But static agents degrade over time. The harness goes stale, new models go unincorporated, context drifts, and latency compounds. Motus closes this gap by learning from every trace (failures, latency, cost, and task outcomes) and using those signals to continuously optimize agent harness, model orchestration, context memory, and end-to-end latency. Early results: higher accuracy than any single frontier model at 2.3× lower cost (Terminal-Bench 2.0, SWE-bench Verified), with 52% lower latency and 45% better memory recall. Open source under Apache 2.0. Works with any agent SDK. Deploy with one command. github.com/lithos-ai/motus lithosai.com/
21
72
570
58,194
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
Mar 29
Excited to see our inaugural CMU Catalyst Research Summit bring together 120 attendees! A full day of discussions on the future of agentic AI systems, multi-modal AI, and ML compilation—with amazing energy from both academia and industry. Co-organized with @tqchenml @BeidiChen @Tim_Dettmers — this is just the beginning 🚀
2
12
87
24,221
Zhihao Zhang retweeted
Yixin Dong@yi_xin_dong
Feb 14
🌟 FlashInfer-Bench accepted to MLSys 2026! FlashInfer-Bench is also the platform for MLSys 2026 AI Kernel Challenge. Tomorrow is the last registration day! If you're into agents and CUDA kernels, be sure to join! 👉 mlsys26.flashinfer.ai So proud of the team for this milestone. Over the past two months, we've witnessed rapid progress in AI Agents for GPU optimization. We have been upgrading our benchmark system and dataset to keep up this pace: better model coverage, stronger safety guardrails. Check out our OSS project: 🔗 github.com/flashinfer-ai/fla… See you on the leaderboard, and see you at MLSys! 👋

4
13
84
7,618
Zhihao Zhang retweeted
Zihao Ye@ye_combinator
Jan 23
🚀 MLSys 2026 Contest - @nvidia Track is LIVE! Registration is now open for the FlashInfer-Bench Challenge! Submit high-performance GPU kernels for cutting-edge LLM architectures on NVIDIA Blackwell GPUs. Three Tracks * MoE (Mixture of Experts) * DSA (Deepseek Sparse Attention) * GDN (Gated Delta Net) Human experts AND AI agents welcome — evaluated separately. Let's see who builds the best kernels! 🤖 🎁 Prizes: Winners take home NVIDIA GPUs and are invited for presentation at MLSys 2026. ⚡ First 50 teams to register get free GPU credits from @modal - huge thanks for the sponsorship @charles_irl ! Whether you're a kernel wizard or building autonomous coding agents, we want to see what you've got. 🔗 Contest details: mlsys26.flashinfer.ai See you at MLSys 2026! 🔥

4
57
294
74,749
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
6 Nov 2025
#MLSys2026 is inviting self-nominations for the External Review Committee (ERC)! If you want to contribute to the review process for the MLSys conference, nominate yourself and help shape this year's program. We especially welcome PhD students and early-career researchers! forms.gle/YdAih8VLuwSF1ErQ9

MLSys'26 External Review Committee (ERC) Self-Nomination

The MLSys'26 External Review Committee (ERC) consists of researchers and practitioners in ML systems who contribute to the review process for papers submitted to the MLSys conference (https://mlsys...

docs.google.com
2
12
20
9,988
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
27 Oct 2025
⏰3 days left to submit to #MLSys2026 (deadline October 30)! Submit your best ML systems work to the Research and Industrial Tracks, and join the MLSys community in Seattle next May. 👉mlsys.org
5
20
13,980
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
21 Oct 2025
Great work! This kind of interoperability will help unlock new cross-compiler optimizations to push kernel performance to the extreme.
Tianqi Chen
@tqchenml
21 Oct 2025
📢Excited to introduce Apache TVM FFI, an open ABI and FFI for ML systems, enabling compilers, libraries, DSLs, and frameworks to naturally interop with each other. Ship one library across pytorch, jax, cupy etc and runnable across python, c , rust tvm.apache.org/2025/10/21/tv…
8
27
4,896
Zhihao Zhang retweeted
Tianqi Chen
@tqchenml
21 Oct 2025
📢Excited to introduce Apache TVM FFI, an open ABI and FFI for ML systems, enabling compilers, libraries, DSLs, and frameworks to naturally interop with each other. Ship one library across pytorch, jax, cupy etc and runnable across python, c , rust tvm.apache.org/2025/10/21/tv…
3
40
164
38,523
Zhihao Zhang retweeted
Shanli Xing@shanli_xing
21 Oct 2025
🤔 Can AI optimize the systems it runs on? 🚀 Introducing FlashInfer-Bench, a workflow that makes AI systems self-improving with agents: - Standardized signature for LLM serving kernels - Implement kernels with your preferred language - Benchmark them against real-world serving workloads - Fastest kernels get day-0 integrated into production First-class integration with FlashInfer, SGLang (@lmsysorg ), and vLLM (@vllm_project ) at launch🙌 Blog post: flashinfer.ai/2025/10/21/fla… Leaderboard: bench.flashinfer.ai/
3
46
147
59,956
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
16 Oct 2025
The #MLSys2026 submission deadline is only 2 weeks away (Oct 30)! Submit your best work on ML systems — spanning hardware, compilers, software, models, agents, and eval. This year features both Research and Industry Tracks! Join us in Seattle next spring! mlsys.org
14
22
4,703
Zhihao Zhang retweeted
Zhihao Jia
@JiaZhihao
20 Aug 2025
🚀Excited to share the #MLSys Call for Papers! For the first time, we’re also welcoming submissions to the Industrial Track. Research and industrial track deadline: Oct 30, 2025 Reviews available: Jan 12, 2026 Author responses: Jan 16, 2026 Notifications: Jan 25, 2026 mlsys.org/Conferences/2026/C… mlsys.org/Conferences/2026/C…

Minjia Zhang@_Minjia_Zhang_
18 Aug 2025
Calling industry researchers: MLSys 2026 launches its first Industrial Track! 🚀 We're excited to announce the inaugural Call for Industrial Track Papers at MLSys 2026! 🎉 👉 mlsys.org/Conferences/2026) This is a unique opportunity for industry researchers and practitioners to share real-world innovations, system deployments, large-scale ML challenges, and lessons learned from practice with the MLSys community. 📌 Details & submission info: Paper submission deadline: Oct 30, 2025 20:00 UTC Full CFP: mlsys.org/Conferences/2026/C… I’m honored to help launch this new track and look forward to seeing your contributions that bridge cutting-edge research with impactful practice. #MLSys2026 #CFP #MLSystems #MLforSystems
5
14
3,483
Kudos to @LijieyYang and the team for the exciting new sparse attention work! LessIsMore is an elegant and effective solution for reasoning tasks. And there is still a lot more we can do on top of this, so stay tuned!
Lijie(Derrick) Yang
@LijieyYang
12 Aug 2025
[1/N] 🚀 Excited to introduce my first work at @Princeton: LessIsMore – a training-free sparse attention method tailored for efficient reasoning in LRMs, achieving lossless accuracy with high sparsity up to 87.5% and 1.1x avg decoding speedup compared to Full Attention on reasoning tasks like AIME-24. (More details in 🧵) 💻 Code: github.com/DerrickYLJ/LessIs… 📄 arXiv: huggingface.co/papers/2508.0… 🔍 HF Daily Paper: huggingface.co/papers/2508.0…
3
104
Load more