Joined February 2017
5,542 Photos and videos
Ray Wang retweeted
US gov restricting Fable and China announcing the 290 Billion AI Buildout is running according to Leopold's timeline almost to a T. Guy called the entire thing out years ago.
19
35
1,153
117,446
👀
I’ve had a number of conversations with folks inside and outside government about the current situation with Anthropic, and here is what I believe to be true: — As we know, Anthropic publicly released its Mythos class models earlier this week under the commercial name Fable. — Fable is Mythos with guardrails. But if those guardrails fail, then you’ve exposed Mythos and its advanced cyber capabilities to people who shouldn’t have them. (Keep in mind that Anthropic itself widely promoted the idea that Mythos was a cyberweapon and needed to be regulated as such. They asked for government regulation of Mythos and championed the guardrails on Fable. If there is a vulnerability — big or small — it is Anthropic’s responsibility to patch.) — A highly credible trusted partner of both Anthropic and the USG who was testing Fable came forward with a jailbreak of those guardrails. The Admin asked Dario to fix the jailbreak or de-deploy the model. Dario refused. — In their blog post, Anthropic defended its decision by saying the jailbreak isn’t serious. That is not what the trusted partner and the USG believe; nor is that kind of minimizing language consistent with Anthropic’s brand as the AI safety company. It’s difficult to fathom how they could claim a jailbreak allowing operability of a cyber weapon could be defined as not “serious.” — In the past, Anthropic has always said that safety must be top priority and taken super seriously. In this case, Anthropic prioritized the continued offering of the consumer model over safety. — In reaction, the Admin issued the export control. The Admin did this reluctantly. It’s been very surprised that Anthropic hasn’t wanted to cooperate with a reasonable safety request (ie fixing the jailbreak issue). Anthropic’s reaction is very much at odds with their branding and ethos as a safe AI research community. — The Admin’s hope now is that Anthropic remediates the safety issue, the export control is lifted, and Fable goes back into general release. The Admin wants all of this to happen as soon as possible. It is frankly bewildered that Anthropic hasn’t wanted to comply with safety requests that it previously said were its highest priority. — Those trying to misdirect and tie this action to the prior DoW/Anthropic issues are wrong. The Admin values Anthropic’s technical capabilities and feels that this issue, while serious, should be easily resolved. The ball is in Anthropic’s court.
5
2,548
Ray Wang retweeted
Expect a resolution soon 👇 “The Admin’s hope now is that Anthropic remediates the safety issue, the export control is lifted, and Fable goes back into general release. The Admin wants all of this to happen as soon as possible.” “The Admin values Anthropic’s technical capabilities and feels that this issue, while serious, should be easily resolved.”
I’ve had a number of conversations with folks inside and outside government about the current situation with Anthropic, and here is what I believe to be true: — As we know, Anthropic publicly released its Mythos class models earlier this week under the commercial name Fable. — Fable is Mythos with guardrails. But if those guardrails fail, then you’ve exposed Mythos and its advanced cyber capabilities to people who shouldn’t have them. (Keep in mind that Anthropic itself widely promoted the idea that Mythos was a cyberweapon and needed to be regulated as such. They asked for government regulation of Mythos and championed the guardrails on Fable. If there is a vulnerability — big or small — it is Anthropic’s responsibility to patch.) — A highly credible trusted partner of both Anthropic and the USG who was testing Fable came forward with a jailbreak of those guardrails. The Admin asked Dario to fix the jailbreak or de-deploy the model. Dario refused. — In their blog post, Anthropic defended its decision by saying the jailbreak isn’t serious. That is not what the trusted partner and the USG believe; nor is that kind of minimizing language consistent with Anthropic’s brand as the AI safety company. It’s difficult to fathom how they could claim a jailbreak allowing operability of a cyber weapon could be defined as not “serious.” — In the past, Anthropic has always said that safety must be top priority and taken super seriously. In this case, Anthropic prioritized the continued offering of the consumer model over safety. — In reaction, the Admin issued the export control. The Admin did this reluctantly. It’s been very surprised that Anthropic hasn’t wanted to cooperate with a reasonable safety request (ie fixing the jailbreak issue). Anthropic’s reaction is very much at odds with their branding and ethos as a safe AI research community. — The Admin’s hope now is that Anthropic remediates the safety issue, the export control is lifted, and Fable goes back into general release. The Admin wants all of this to happen as soon as possible. It is frankly bewildered that Anthropic hasn’t wanted to comply with safety requests that it previously said were its highest priority. — Those trying to misdirect and tie this action to the prior DoW/Anthropic issues are wrong. The Admin values Anthropic’s technical capabilities and feels that this issue, while serious, should be easily resolved. The ball is in Anthropic’s court.
3
30
7,428
Ray Wang retweeted
Our current thesis remains unchanged: PTFE is merely a secondary, non-mainstream solution that is highly unlikely to achieve commercial mass production. Instead, the M10Q configuration remains the clear preferred choice, primarily because it offers a broader pool of qualified suppliers and commands strong deployment support from tier-1 PCB fabricators.
1
1
33
4,206
Crazy stuff....
OpenAI now just needs to sandbag the next model release So the US doesn't export control them So they gain massive market share It's imperative that all the OAI employees don't vauge hype post their next model release as the greatest thing ever Don't know if they are capable tho
1
15
8,365
Ray Wang retweeted
Replying to @roaner
Great work, Ramine and team! A couple of things to note: 1. It seems like your ATOM disagg PR is still a WIP, as an AMD engineer was still pushing commits to it as of a couple of hours ago. Our team is happy to review the ATOM disagg PR once it’s ready. 2. For half of your curve for DSr1, it gets an accuracy of 0.0 due to various bugs, as tracked in the SGLang ticket #27194. If you had nightly DI tests as suggested in SGLang ticket #22464 , these accuracy issues would be prevented.
1
40
5,759
Ray Wang retweeted
Jun 10
everyone bashing Semianalysis, FundAI, etc. should instead look within. why are we trading everything on leverage, responding FAST before reading digesting and being quick to freak out? the issue is the borderline insane overreactions to these notes, not the notes themselves
29
10
246
28,219
"Local LLMs are the Great Leap Forward for Inference." So funny lol
Local LLMs are the Great Leap Forward for Inference. Every laptop is it's own datacenter, sovereignty over your own tokens, and the people can seize the means of token generation. And that's why it's destined for poor results. (1/4)🧵
2
14
4,932
Ray Wang retweeted
Fable 5 is state-of-the-art on nearly all tested benchmarks, with exceptional performance in software engineering, knowledge work, scientific research, and vision. The longer and more complex the task, the larger Fable 5’s lead over our other models.
511
1,789
15,529
5,419,456
Ray Wang retweeted
China's Unitree Will Dominate Global Robotics The Fastest Iteration Cycle In Next-Gen Robotics Should See Unprecedented Acceleration newsletter.semianalysis.com/…
52
171
1,129
466,356
Ray Wang retweeted
Even if Unitree doesn't dominate global robotics, American startups still depend on the Chinese hardware supply chain Unitree’s Verticalization Is Remarkable - Even In China "Unitree self-develops BLDC motors, planetary gearboxes, LiDARs, and depth cameras, each typically (or even previously for Unitree) outsourced by other Chinese humanoid OEMs. Instead, Unitree’s self-produced motors can run as low as 30-40% of equivalent Western motors, and they now make some of the cheapest humanoid gearboxes in the world."
China's Unitree Will Dominate Global Robotics The Fastest Iteration Cycle In Next-Gen Robotics Should See Unprecedented Acceleration newsletter.semianalysis.com/…
5
8
42
10,095
Ray Wang retweeted
What EU regulations does to AI
14
29
552
41,037
💀
Qualcomm is a piece of shit supplier to anyone trying to innovate on the edge, especially startups. My client is trying to buying ~500,000 of SoCs and wants them to be American because patriotism. Instead Qualcomm has them waiting months to even get pricing, just to be quoted with 80% margins at lead times that are not competitive with overseas suppliers. They're about to ship the M1: 37g, IMU, Camera, NPU, CPU, WiFi/BT, entirely hardware synchronized and designed for mass-manufacturing. Hundreds of thousands pre-ordered, scaling to millions, for next-gen devices for robotics, automotive, night vision... Client wants to build American but the way Qualcomm is engaging right now means we have to keep building perception and compute systems with overseas suppliers. Mediatek priced it better and more competitive lead times. The China suppliers such as Rockchip are even faster but cant do that.
1
9
6,632
Ray Wang retweeted
Our Vera SOCAMM note is causing a bit of a stir. As always some folks are jumping to the wrong conclusions. Those saying this is fake news clearly didn't visit the Hynix booth at Computex.
7
41
368
72,168
Ray Wang retweeted
Well deserved
20
23
1,202
273,831
Hardware OG at OAI to Ant 👀
Personal update: I’ve decided to leave OpenAI. I’m proud to have been part of the custom chip program and grateful to everyone I got to build with and learn from along the way. The density of hardware talent on that team is extraordinary, and I don't think there's a better chip design team anywhere. It's been a wild journey from second hardware hire, 2.4 years ago, to now, and I'm excited to watch these chips become one of the most important engines of AGI. At the same time, I haven’t been able to shake the pull to climb a new mountain from the bottom again! I joined @AnthropicAI this week because I was deeply impressed with the team’s talent, values, and ambition, and I'm already energized by the pace and intensity of the past few days. It’s time to build.
1
1
78
19,403
😂😂
1
2
23
8,776
Ray Wang retweeted
Awesome article & visuals by the Bloomberg team here. -Historical evolution of data center sizes and how massive the proposed projects are compared to the cumulative history of the industry. -Evolution of rack sizes (which drive ultimate power demand; cpu -> GPU -> higher TDP GPUs) -Include other diagrams like where the chip goes in the rack, air vs. liquid cooling, all the steps of how voltage gets stepped down from distribution line to rack level other things but this is exactly the type of stuff that makes this content more accessible to broader audiences in a way that nerds like I can't describe well haha Fun facts: -Right now, around 30% of the power flowing into data centers is not used to generate AI, according to Nvidia. [thats just saying 1.3 PUE - you need power for overhead, electrical, cooling, etc. - you will always have some level of this FYI] -Liquid cooling can increase energy efficiency in a data center by 15%, according to a study done by Nvidia and power equipment maker Vertiv -"Data centers also step down the voltage of grid power from 34,500 volts — the dangerously high voltage levels that travel through powerlines — to the 12 volts chips need." [All of these steps introduce inefficiencies.] -..."since more powerful racks require higher voltages, the sidecar can feed them with 800 volt DC power, improving energy efficiency by 20% compared to the current system... With a 1 megawatt sidecar, racks can reach 500 kilowatts, roughly ten times more than before." -"The industry is vying to replace some of the electrical room equipment with a solid state transformer — a smarter, electronic device that can switch currents between AC and DC and better handle higher voltages. This enables even denser racks and improves energy efficiency by 27% compared to the current system"
2
43
180
12,284
Dan shipped this in middle of Computex 😭😭😭😭😭
To Boldly Go: The Case for Space Datacenters Space DC Total Cost of Ownership Explained. Unpacking constraints from Terrestrial DCs and Chip Production. Space-Earth Parity in the late 2030s, Space DCs could start to be viable even sooner. newsletter.semianalysis.com/…
1
2
21
17,122