Joined August 2017
- Tweets 20,917
- Following 1
- Followers 428
- Likes 4,684
20 Photos and videos
PerthMLGroup retweeted
22 Feb 2023
In our paper arxiv.org/abs/2302.10360 on the arXiv today, we present results from a study investigating the energy-efficiency advantage that could be achieved in executing state-of-the-art Transformer models on optical hardware.
1
9
37
3,237
PerthMLGroup retweeted
21 Feb 2023
🎉 We are thrilled to announce the release of the latest version of mlforecast a #Python library for Scalable #machinelearning 🤖 for #timeseries #forecasting
🚀 This version comes with exciting new features that are sure to make forecasting even more efficient and accurate
🧵
4
69
283
53,184
Cyborgism Research Agenda
-Does not try to make GPT an agent
-Leverages GPT as a general simulator
-LLMs reason from scratch about any situation
-Advanced prompting interfaces
-Branches GPT chains of thought
-Injects variance into human thoughts
Post alignmentforum.org/posts/bxt…
3
26
201
27,704
PerthMLGroup retweeted
22 Feb 2023
This quietly slipped out yesterday. Briefly, the UK is traditinally a strong source of clinical trials but patient recruitment has fallen by 44% (!) due to slow & unpredictable set-up of research sites.
Independent review into UK clinical trials buff.ly/3lVWGtx
5
5
2,681
PerthMLGroup retweeted
22 Feb 2023
One exciting feature of our partnership with AWS is that we now have 1000 GPUs to start training really large models at @huggingface 🔥🔥🔥!
We’ll be working hard to make closed models open, starting with LLMs and friends 🤓
Which closed models would you like to be open?
38
150
1,291
208,070
Recitation-Augmented LLMs
-Usually: Retrieve relevant docs & give to LLM to answer
-Instead: Recite relevant passages from LLMs' own memory via sampling,
then produce final answer
-State-of-the-art on closed-book Q&A
Paper arxiv.org/abs/2210.01296
Code github.com/Edward-Sun/RECITE
7
49
257
54,351
PerthMLGroup retweeted
22 Feb 2023
German AI startup @Aleph__Alpha claims it will have a 300-billion parameter Large Language Model "Luminous-World" trained this year for “highly complex and critical applications”
(GPT-3 has 175 billion parameters)
17
49
347
88,007
We're excited to welcome FuseMedML to the PyTorch ecosystem!
FuseMedML is part of the BiomedSciAI organization which provides tools for AI-based accelerated discovery of biomarkers and molecules in the biomedical domain.
See the latest here: hubs.la/Q01D6TZ70
3
17
51
15,663
PerthMLGroup retweeted
22 Feb 2023
Robust Hybrid Learning With Expert Augmentation
Antoine Wehenkel, Jens Behrmann, Hsiang Hsu, Guillermo Sapiro, Gilles Louppe, Joern-Henrik Jacobsen.
Action editor: Jasper Snoek.
openreview.net/forum?id=oe4d…
#expert #models #modelling
6
14
8,313
PerthMLGroup retweeted
22 Feb 2023
"MarioGPT: Open-Ended Text2Level Generation through Large Language Models"
This looks like a pretty fun and creative project!
The best part, it's based on a distilled GPT-3 model and can be trained on a single GPU.
8
68
384
76,606
PerthMLGroup retweeted
28 Jan 2023
On a Welsh island, a seagull swallows a rabbit whole.
880
2,408
10,801
2,300,798
PerthMLGroup retweeted
28 Jan 2023
Supercontinuum in 100m of 50 micron Fiber
youtube.com/watch?v=l6uH0Ok9…
2
10
76
9,109
PerthMLGroup retweeted
28 Jan 2023
In the last week, three people on reddit/r/statistics have asked about testing whether a sample came from a Gaussian distribution.
The answer is that you should never test for normality. The result is a non-answer to the wrong question.
allendowney.com/blog/2023/01…
33
194
1,501
788,493
PerthMLGroup retweeted
28 Jan 2023
.@TalarianHQ's `GPT for Sheets™` is the gift that keeps on giving! 🔥
Look at how easy it is to create personalized content with it, thanks to #GPT3's seamless integration! 🤯👇
Get the add-on here:
🔗workspace.google.com/marketp…
23 Jan 2023
Now it's even easier to use #GPT3 in @googlesheets with @TalarianHQ's `GPT for Sheets™` extension! 🔥
Check out their new `GPT_FILL()` function! 👇
🔗 workspace.google.com/marketp…
7
96
421
151,212
PerthMLGroup retweeted
27 Jan 2023
I think this link will be useful: google-research.github.io/se…
the paper: arxiv.org/abs/2301.11325
also they released a dataset:
kaggle.com/datasets/googleai…
it's a shame the actual library is not available but the research article is pretty good
6
25
17,642
PerthMLGroup retweeted
25 Jan 2023
Batch normalisation appears to be falling out of favour (probably for the best IMO, so many bugs end up being batchnorm bugs😬).
One area where it persists is GAN discriminators (e.g. in StyleGAN-T and VQGAN). Are there any other settings where batchnorm is still hard to avoid?
15
18
229
177,067
The first text line detection model for historical documents available on @huggingface : paper code models, all open-source huggingface.co/Teklia/doc-uf… teklia.com/research/publicat… #digitalhumanities @LitisLab
5
69
232
46,558
[CV] Learning Good Features to Transfer Across Tasks and Domains
P Z Ramirez, A Cardace, L D Luigi, A Tonioni, S Salti, L D Stefano [University of Bologna & Google] (2023)
arxiv.org/abs/2301.11310
#MachineLearning #ML #AI #CV
[1/2]
1
7
11
1,290
PerthMLGroup retweeted
27 Jan 2023
Just published a literature review on scaling laws @EpochAIResearch! I collected a database of scaling laws for different tasks and architectures and reviewed dozens of papers in the scaling law literature.
Check out the database!
docs.google.com/spreadsheets…
🧵
3
21
88
11,087