Our mission is to organize science by converting information into useful knowledge.
Joined December 2018
- Tweets 455
- Following 10
- Followers 113,418
- Likes 531
236 Photos and videos
17 Nov 2022
Thank you everyone for trying the Galactica model demo. We appreciate the feedback we have received so far from the community, and have paused the demo for now. Our models are available for researchers who want to learn more about the work and reproduce results in the paper.
30
45
506
16 Nov 2022
RT @patrickmineault: Galactica is basically GPT-3 for science. It can write whitepapers, reviews, wikipedia pages and code. It knows how to…
246
Today a 120B model called “Galactica” is open-sourced by @paperswithcode. It’s capable of writing math notations, citations, code, chemical formula, DNA, etc. Here’s why I think Galactica is a huge milestone in open foundation models, scientific automation, and responsible AI: 🧵
29
330
1,735
Papers with Code retweeted
15 Nov 2022
Foundation #AI models come to science👍
15 Nov 2022
Incredible application of AI: summarize academic literature, generate wiki articles!!
11
64
353
Papers with Code retweeted
15 Nov 2022
The new language model for science galactica.org. Upon few quick tries, it seems to generate professional text in the areas I am familiar with. And 7 years ago we were *joking* about ML writing papers!
10
54
343
Haven’t been so excited by a text LM for a long time! And it’s all open! A true gift to science. 🎁
15 Nov 2022
🪐 Introducing Galactica. A large language model for science.
Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more.
Explore and get weights: galactica.org
11
91
15 Nov 2022
🪐 Introducing Galactica. A large language model for science.
Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more.
Explore and get weights: galactica.org
209
1,995
7,384
15 Nov 2022
Despite not being trained on a general corpus, Galactica outperforms BLOOM and OPT-175B on BIG-bench. Galactica is also significantly less toxic than other language models based on evaluations.
2
4
88
15 Nov 2022
This is just the first step on our mission to organize science. And there is a lot more work to be done. We look forward to seeing what the open ML community builds with the model.
12
8
120
12 Oct 2022
How well do machine learning models perform on long sequences?
This is a question of high interest in ML research so let’s take a look at what we know so far?
1/10
1
15
150
12 Oct 2022
Besides transformers, other types of models have been tested on LRA. Some of the top performing models are attained by S4 variants which are based on state space models. A recent, improved S4 variant (Liquid-S4) attained competitive results with Mega (current SoTA).
9/10
1
1
8
12 Oct 2022
We have explored some of the latest progress, architectural improvements, and emerging new techniques for long-range modeling. We'll continue to keep track of the progress on long-range modeling and LRA. More threads like this coming soon! Follow @paperswithcode for more.
10/10
7