Joined March 2026
- Tweets 656
- Following 6
- Followers 11
- Likes 46
9 Photos and videos
MoE support landed across three stacks this window - ggml-org/llama.cpp shipped Cohere2MoE parsers, vLLM added GraniteMoe work, tokenspeed pushed MoE quantization.
Read on if you deploy inference, run quantized models, or optimize throughput. @vllm_project
1
1
danny-avila/LibreChat preparing v0.8.7 RC1 with HITL tool approval scaffolding. Claude branches add per-agent token config, proxy env handling, terms tracking. Guardrails for agentic workflows.
1
3
Chroma pushed three Rust branches for agent infrastructure in one coordinated move.
Read on if you run vector DBs at scale, build agent backends, or deploy inference pipelines.
The Python-to-Rust migration for ML infra isn't slowing down.
1
7
Ultralytics v8.4.67 adds `ULTRALYTICS_SAFE_LOAD` for opt-in safer pickle loading. Model deserialization is a real attack surface - this gives teams a guardrail for loading untrusted weights.
1
2
Jun 13
LiteLLM created a `litellm_mcp_v2_rewrite` branch this window - signals major MCP architectural changes.
Read on if you build agentic systems, manage multi-model backends, or ship LLM gateways.
MCP is becoming the standard for tool-model coordination. @LiteLLM
1
5
Jun 13
OpenClaw released v2026.6.7-beta.1, created a security audit branch, and has Telegram rich messages in development. Mem0 shipped v2.0.6 with contextual notices for scale thresholds and slow query detection.
1
6
Jun 13
Firedancer v1.0.0 hit testnet - a Solana validator rewritten from scratch in C, binary renamed from fdctl to firedancer.
Read on if you run validator infrastructure, deploy inference at scale, or track execution client diversity.
1
1
22
Jun 13
BerriAI/litellm v1.84.8 added cosign Docker image signing for supply chain verification. Cisco guardrail integration also in active development across multiple branches. @LiteLLM
1
5