The Brain-Score platform aims to yield computational models of how the brain gives rise to the mind. Benchmarks (neural behavioral along with SOTA brain models

Joined October 2021
35 Photos and videos
Pinned Tweet
It's a wrap! Across 46 new benchmarks from 8 submitters, we have now evaluated 19 reference models for a total of 874 alignment scores. These new behavioral and neural benchmarks are showing the short-comings of our models (although some occasionally prevail). Winners TBA at CCN!
🧠 Announcing the 2024 Brain-Score Benchmarking Competition 📣 This year — we have turned the table! We invite experimentalists and the community at large to expose the explanatory gaps between current models of primate vision and the biological brain. brain-score.org/competition/ 1/
2
12
3,103
All the benchmarks from the Brain-Score Benchmarking Competition @CogCompNeuro are now live on brain-score.org/vision. Huge thanks again to all who submitted! We're looking forward to new models improving on those benchmarks

1
12
531
Brain-Score retweeted
Thanks so much to all the contributors! We honestly didn't expect this many submissions, and even better there are now new benchmarks as goal posts for computational models. See you at CCN in August :)
It's a wrap! Across 46 new benchmarks from 8 submitters, we have now evaluated 19 reference models for a total of 874 alignment scores. These new behavioral and neural benchmarks are showing the short-comings of our models (although some occasionally prevail). Winners TBA at CCN!
3
29
2,182
By popular demand we have extended the competition deadline until *July 8*. Please make sure to submit your final benchmarks by then, and we will let you know asap if you broke the SOTA models :)
🧠 Announcing the 2024 Brain-Score Benchmarking Competition 📣 This year — we have turned the table! We invite experimentalists and the community at large to expose the explanatory gaps between current models of primate vision and the biological brain. brain-score.org/competition/ 1/
1
1
1,147
The 2024 Brain-Score competition now has a confirmed $10k prize pool. Prizes are split up across behavioral and neural benchmark submissions. Only a little over 20 days left!
🧠 Announcing the 2024 Brain-Score Benchmarking Competition 📣 This year — we have turned the table! We invite experimentalists and the community at large to expose the explanatory gaps between current models of primate vision and the biological brain. brain-score.org/competition/ 1/
10
26
4,164
The 2024 Brain-Score Benchmarking Competition is now officially part of the @CogCompNeuro schedule. We will announce winners as part of the CCN conference -- only 1.5 months left to submit your benchmark!
🧠 Announcing the 2024 Brain-Score Benchmarking Competition 📣 This year — we have turned the table! We invite experimentalists and the community at large to expose the explanatory gaps between current models of primate vision and the biological brain. brain-score.org/competition/ 1/
2
14
2,730
Brain-Score retweeted
Well that should be easy!
🧠 Announcing the 2024 Brain-Score Benchmarking Competition 📣 This year — we have turned the table! We invite experimentalists and the community at large to expose the explanatory gaps between current models of primate vision and the biological brain. brain-score.org/competition/ 1/
1
1
266
Brain-Score retweeted
This is an absolutely brilliant idea! Bravo!
🧠 Announcing the 2024 Brain-Score Benchmarking Competition 📣 This year — we have turned the table! We invite experimentalists and the community at large to expose the explanatory gaps between current models of primate vision and the biological brain. brain-score.org/competition/ 1/
1
2
17
2,199
Brain-Score retweeted
Super excited for the 2024 Brain-Score Benchmarking Competition. Submissions will be rewarded on how much the current best models fail on them! We have been working hard to make model testing easy and I hope this competition uncovers some explanatory gaps in our models of vision
🧠 Announcing the 2024 Brain-Score Benchmarking Competition 📣 This year — we have turned the table! We invite experimentalists and the community at large to expose the explanatory gaps between current models of primate vision and the biological brain. brain-score.org/competition/ 1/
1
13
60
8,132
🧠 Announcing the 2024 Brain-Score Benchmarking Competition 📣 This year — we have turned the table! We invite experimentalists and the community at large to expose the explanatory gaps between current models of primate vision and the biological brain. brain-score.org/competition/ 1/
2
32
85
30,054
We provide the entire compute infrastructure along with model implementations brain-score.org/competition/… (also see the tutorials). In addition, we will incentivize benchmark submissions by providing visibility to participants and monetary prizes (TBA) to the winning benchmarks. 4/
1
7
673
There are two tracks to participate in (behavioral neural), both with multiple prizes. Submissions are due by the end of June, and the winners will be invited to present at MIT in August at a workshop co-occurring with CCN. Happy benchmarking! /fin
7
14
4,730
Brain-Score retweeted
19 Oct 2022
15/ These are only some of the directions we are currently exploring that stem from having brain-aligned models of machine vision (e.g. see @brain_score), so if you are a small/medium/large business or research lab and would like to work with us, also let us know!
1
1
9
Brain-Score retweeted
23 Oct 2022
2/4 But can't neuro up its contribution via large-scale datasets of neural responses on tasks that AI isn't yet good at? These can be either benchmarks (as in @brain_score) or as optimization targets (cool progress from Leila Wehbe @mldcmu & co using @cvnlab's NSD dataset).
2
1
25
Congratulations to the Open Data at MIT winners! Quest researchers received an honorable mention for @brain_score and iCatcher!! @kvdmgallagher @martin_schrimpf libraries.mit.edu/opendata/o…

1
8
On the second day of the Brain-Score and beyond workshop (March 22 #cosyne2022), we will highlight several key participations to the first edition of the Brain-Score Competition. brain-score.org/competition/

1
3
7
Then, at 10:40am, Alexander Riedel will present the winning model of the Brain-Score Competition 2022 with his work "Bag of Tricks for Training Brain-Like Deep Neural Networks" openreview.net/pdf?id=SudzH-…
1
2
Finally, at 3:30pm, William Berrios and Arturo Deza will present the work behind the second best model submission, "Joint rotational invariance and adversarial training of a dual-stream Transformer yields state of the art Brain-Score for Area V4" openreview.net/pdf?id=SOulrW…
1
3