life yearner @lossfunk by day, folding manifolds by night, more personal alt @moodynamics

Joined January 2021
713 Photos and videos
Pinned Tweet
Apr 6
if anyone is willing to organise this in the himalayas this summer we would be forever grateful to you and just imagine the service you would be doing to everyone being there! it is time to go back to the original ways
Apr 6
Replying to @arcaman07
i think we should have a reading retreat like the spiritual retreats where all one can do is read papers and blogs
11
1,480
"and when people couldn't find this oscillation for a few days....they resorted to releasing these models on their own trying to experience the lost bliss"
Jun 13
> new model comes > people get happy/sad with it > new model goes > people get happy/sad with it > new model comes again..... when will the people realise....? there are better ways to spend your time than this
1
4
129
bsky calls up again, at least they havent started doing this there
38
Jun 13
> new model comes > people get happy/sad with it > new model goes > people get happy/sad with it > new model comes again..... when will the people realise....? there are better ways to spend your time than this
2
13
238
Jun 13
also the ai bubble shit takes, please don't force me to leave this place, nothings bursting because it never existed in the first place, the only bubble is 🫵
1
2
40
Jun 11
woah would have loved if this released ~1 month ago coinciding with the @GRaM_org_ competition for airflow prediction, love the DEC approach they take (my very naive approach of building something of a TNO looked really bad) very exciting work again!
Replying to @tolga_birdal
We also design an anisotropic Darcy benchmark with randomly oriented face-wise diffusion tensors. Here, respecting the native topological degree of physical quantities matter and lead to more faithful operator learning, reflected in significant performance gains for our TNOs.👇
1
1
8
304
Jun 11
would be fun to try it out over the CC's from the dataset this weekend and see where it lands up on the leaderboard (hopefully they release the code until then and make this easier)
1
43
Jun 11
maybe it was all just about the 10 different tabs of paul graham essays that you have open on a thursday for light reading but now you want to spend rest of the day reading and writing about random things
1
8
151
Jun 11
similar kind of days are reserved for gwern,alexey guzey, boz,scott alexander; some of these days i will put all of these together
1
35
Jun 9
was watching this super interesting video about cut locus of riemannian manifolds (i dont even remember how i stumbled upon it a week ago), the speaker started in english and just when i thought this is it he switched to french anyways this is how i got back to learning french
1
5
816
weeye retweeted
Jun 7
uh oh
1
3
100
Jun 7
pantheon is such a riveting watch, makes you think about so many things at the same time. the loop is something like > hear about something x > have insane opinions about x > want to write about it > almost instantly y drops into the picture > cycle continues
1
8
147
Jun 7
uh oh
1
3
100
weeye retweeted
New research from @japhba and I! Activation Oracles are a pretty cool interpretability tool. They answer natural questions about activations, but they suffer from vagueness and hallucinations. Can AO training be improved? Turns out: Yes! We identify four fixes that make AOs substantially more useful!
12
24
225
30,992
Jun 4
how life currently feels like with all these local minimas, better optimization techniques are being found as we speak!
1
1
14
666
May 28
unsure whether this is what would get me to write (publish) more content online or end up being counterintuitive and take the fun out of it
1
5
122
May 28
but anyways i think this is very cool by @yudhister and super fun to see him stick to it!
1
1
73
weeye retweeted
Short blog on why I think SSL isn't scaling. tldr we're suppressing too much information from the SSL loss so that anything is learnt at all, but this limits the total set of things we may be able to learn. jchencxh.github.io/blog/scal…
10
26
224
34,917
May 15
while on this topic i came across this very neat compilation by @_vaishnavh, ill leave you with this line anon! "I contend that you cannot learn this emotional maturity efficiently through the brute-force of the research process alone. You need to read."
May 12
the value of understanding the history of your field is highly undervalued and you know what it probably is so interesting that once you start it becomes impossible to abandon it mid way p.s its also coupled with multiple side effects that help on the journey!
1
2
13
399