We’re thrilled to see our advanced ML models and EMG hardware — that transform neural signals controlling muscles at the wrist into commands that seamlessly drive computer interactions — appearing in the latest edition of @Nature.
Read the story: nature.com/articles/s41586-0…
Find more details on this work and the models on @github: github.com/facebookresearch/…
here is sora, our video generation model:
openai.com/sora
today we are starting red-teaming and offering access to a limited number of creators.
@_tim_brooks@billpeeb@model_mechanic are really incredible; amazing work by them and the team.
remarkable moment.
I'm incredibly saddened today to hear about the passing of Prof. Craig Henriquez, one of my first research advisors when I was an undergrad. Craig was an incredible mentor, scientist, and compassionate human being; he will be deeply missed. today.duke.edu/2023/08/craig…
1/Our paper @NeuroCellPress "Interpreting the retinal code for natural scenes" develops explainable AI (#XAI) to derive a SOTA deep network model of the retina and *understand* how this net captures natural scenes plus 8 seminal experiments over >2 decades sciencedirect.com/science/ar…
Sometimes I want to be a computational neuroscientist just so that I can make minimalist talks with only keynote drawings and whatever that cool sans serif font is
Gradients without Backpropagation
Presents a method to compute gradients based solely on the directional derivative that one can compute exactly and efficiently via the forward mode, entirely eliminating the need for backpropagation in gradient descent.
arxiv.org/abs/2202.08587
Some personal news: I recently joined Facebook Reality Labs, working on neural interfaces research with the CTRL labs team. Sad to leave fantastic colleagues at Google Brain, but looking forward to a new challenge! 🧠 💪
A classic kinematics example—a pillbug on a spinning disk walks back and forth on (what it thinks is) a straight path.
However, its trajectory looks much more complicated and beautiful to a stationary observer!
"Intuition is the foundation upon which comprehensive understanding is built. But ... unverified intuition can be misleading." A fantastic article on rigorous interpretability research by @leavittron and @arimorcos (arxiv.org/pdf/2010.12016.pdf) h/t @KordingLab for highlighting it!
Cool result: minimizing activation norms in a network (a proxy for energy efficiency) in a predictable environment yields a network that learns aspects of predictive coding. Would love to see what happens in richer environments and with deeper architectures!
New preprint alert! We show that predictive coding is an emergent property of input-driven RNNs trained to be energy efficient. No hierarchical hard-wiring required. A thread: 1/
biorxiv.org/content/10.1101/…
The only reason this image is “powerful” is as a reminder of how misleading data visualization can be. It uses a diverging colormap for sequential data, and caps the range at 4% so the UK pops out as if they’ve vaccinated a majority of citizens. Good example of what *not* to do!
OK, finally our tweeprint for the NeurIPS paper. Here we go. Synaptic plasticity, it's the holy grail of learning and memory. This is work by @basile_cfx, @hisspikeness, @ejagnes, @countzerozz & myself, on how to find the grail, maybe biorxiv.org/content/10.1101/…
If you need an escape from politics right now, I'm giving a talk at the DeepMath conference (@deepmath1) this afternoon (2:20pm PST) on understanding the dynamics of learned optimizers. There is a livestream: youtube.com/watch?v=x-VPsHyf… - the talks so far have all been fantastic!