Joined November 2021
266 Photos and videos
Pinned Tweet
hi, let me introduce you to LLMTor - a service allow you to access frontier models (Like chatGPT) anonymously. Try it! llmtor.com On HN: news.ycombinator.com/item?id… It cryptographically breaks the link between your identity and your prompts, using blindrsa [rfc9474] and tor, such that even if server becomes malicious, it cannot know which user sent a particular prompt Give it a try! The source code: github.com/prince776/LLM-Tor I will make a detailed youtube video on problem solving that lead to this, if that sounds like something you're interested in, let me know :D Also, interactive protocol demo: api.llmtor.com/demo
8
7
58
8,057
Prince Gupta retweeted
I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out. I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really). It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely. The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture. We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying. I worry.
512
1,901
15,325
1,586,619
i think using an easy and fun language to actually write the software and then using AI to port it to rust is a great pattern to be adopted
Bun v1.3.14 releases tomorrow. If we do merge the Rust rewrite, this would be the last version in Zig
9
1,238
disaggregated storage based db like this can be faster on S3 than NVMe for very specific use cases, but for general case fair comparison, this is clickbait I believe
Postgres on S3 is faster than Postgres on NVMe
3
1,033
Prince Gupta retweeted
Replying to @kayleecodez
hate to say it, but everyone that rejects kubernetes inevitably ends up recreating it from first principles lol
39
46
1,148
240,524
once again i was not able to sleep all night 3rd time this month already I think I've forgotten how exactly to sleep...
4
7
1,596
Prince Gupta retweeted
You have to review all LLM code! Codex 5.5 tried to push this awful hack to our Metal backend when it was coding font rendering. It decided to implement hacky "robust buffer access" style OOM check inside the shader and hacked our whole Metal binding architecture to add a special bind group slot 30 (hardcoded) to deliver sizes of all buffer bindings. This of course made the binding model super slow and required extra data for each buffer.
38
26
684
88,117
Prince Gupta retweeted
> unlike gaming which can just lag and reduce FPS, video (de)compression must maintain real-time to have smooth video What? Neither of those are *hard* real-time systems. And arguably a stall is significantly more noticeable in games, as they need to react to user input
Apr 22
This is the reason FFmpeg is not written in a Garbage Collected language. We can't just stall for a few milliseconds. Also unlike gaming which can just lag and reduce FPS, video (de)compression must maintain real-time to have smooth video. 1ms is a lot but it isn't at the same time.
23
10
698
74,304
i wonder if security will ever become a stronger moat than UX, especially in an era where custom ux is pretty accessible
Apr 19
We’ve identified a security incident that involved unauthorized access to certain internal Vercel systems, impacting a limited subset of customers. Please see our security bulletin: vercel.com/kb/bulletin/verce…
5
1,316
anyone attending this, whom i can hang out with
1
18
1,120
RT @DanielcHooper: Jonathan Blow on fast software
116
Will be presenting here on sunday as part of rubrik anybody going there?
1
9
1,127
For the last 7 out of 10 days, I've not been able to sleep the entire night. Really miss the days when i did not have dread and lack of will to live FROM 6am in the morning. :(
3
15
1,319
it’s an era of slopware development
Every. single. day. It's increasingly becoming difficult to do real work with GitHub. Git isn't the issue, since I can work offline. Its issues, PRs, CI, etc. Imagine going to work and your workstation randomly restarts a few times a day. That's what it feels like using GH.
11
962
not that i am eligible for monetization but even if i were…
1
1
587
did you know most people don’t actually like http3 and will probably never adopt it
1
1
650
is there an actually good AI tool for video editing? i don’t mean prompt to video gen.
1
572
While a decent amount of people visited LLMTor, not many used it. I think it's because no one wants to use desktop app? Although web client fundamentally won't be as secure, for easier use, i've added it now chat.llmtor.com
3
711
grok video gen is pure garbage you can’t pay me enough to pretend otherwise
geez have you seen how good Grok Imagine is getting one shotted this video with a 6 word prompt
2
7
2,494
Prince Gupta retweeted
Junior and mid-level engineers can no longer push AI-assisted code without a senior signing off at AWS
Amazon is holding a mandatory meeting about AI breaking its systems. The official framing is "part of normal business." The briefing note describes a trend of incidents with "high blast radius" caused by "Gen-AI assisted changes" for which "best practices and safeguards are not yet fully established." Translation to human language: we gave AI to engineers and things keep breaking? The response for now? Junior and mid-level engineers can no longer push AI-assisted code without a senior signing off. AWS spent 13 hours recovering after its own AI coding tool, asked to make some changes, decided instead to delete and recreate the environment (the software equivalent of fixing a leaky tap by knocking down the wall). Amazon called that an "extremely limited event" (the affected tool served customers in mainland China).
182
733
8,662
1,276,554
Prince Gupta retweeted
hi, let me introduce you to LLMTor - a service allow you to access frontier models (Like chatGPT) anonymously. Try it! llmtor.com On HN: news.ycombinator.com/item?id… It cryptographically breaks the link between your identity and your prompts, using blindrsa [rfc9474] and tor, such that even if server becomes malicious, it cannot know which user sent a particular prompt Give it a try! The source code: github.com/prince776/LLM-Tor I will make a detailed youtube video on problem solving that lead to this, if that sounds like something you're interested in, let me know :D Also, interactive protocol demo: api.llmtor.com/demo
8
7
58
8,057