A recent work from @iddo claimed GPT4 can score 100% on MIT's EECS curriculum with the right prompting.
My friends and I were excited to read the analysis behind such a feat, but after digging deeper, what we found left us surprised and disappointed.
dub.sh/gptsucksatmit
🧵
Exploring the MIT Mathematics and EECS Curriculum Using Large Language Models
Presents a comprehensive dataset of 4,550 questions and solutions from all MIT EECS courses required for obtaining a degree
arxiv.org/abs/2306.08997
Why AI Will Save The World
By Marc Andreessen
The era of Artificial Intelligence is here, and boy are people freaking out.
Fortunately, I am here to bring the good news: AI will not destroy the world, and in fact may save it.
🧵
A new Ahead of AI issue is out, where I am covering the latest research highlights concerning LLM tuning and dataset efficiency: magazine.sebastianraschka.co…
Everyone should learn to fine-tune LLMs.
You can try (and fail) to force GPT-4 on to every solution, or you can reduce your costs and improve your accuracy by fine-tuning a task-specific LLM.
Here's why, and some tips for getting started:
We're launching ten $100,000 grants for building prototypes of a democratic process for steering AI. Our goal is to fund experimentation with methods for gathering nuanced feedback from everyone on how AI should behave. Apply by June 24, 2023: openai.com/blog/democratic-i…
2023 is the year AI/ML went from:
-> people cherry-picking examples of systems giving the right answers
to:
->people cherry-picking examples of systems making mistakes.
Tells a lot on the giant leap we just made.
Unashamed bragging: in 2007, on page 69 of my PhD thesis, I explained how to build a kind of language model on a Terabyte-sized dataset. Pre-Deep NN era: ruor.uottawa.ca/handle/10393…
Prompt Engineering Guide (1.8K ⭐️)
Organized papers by date so it's easier to track the latest developments in prompt engineering. All the latest tools added too!
github.com/dair-ai/Prompt-En…
OpenAI just launched the "AI Text Classifier" to identify texts generated by AI.
Tried it, and IT DOES NOT WORK.
platform.openai.com/ai-text-…
Using my Python ML book published in 2015:
1) @randal_olson's foreword: unclear
2) my preface: possibly AI
3) paragraph from Ch1: likely AI
Open Problems in Applied Deep Learning
If you're looking for interesting open problems in DL, this is a good reference.
Not sure if intentional but it also looks useful to get a general picture of current trends in deep learning with ~300 references.
arxiv.org/abs/2301.11316
AI community: make sure to review the output of AI, generate alternate images, refine your prompt (else it's often creepy lol).
MarketWatch: 'image of a bear in a house of mirrors' noice, publish.