I'm an inventor, scientist and engineer. My passion is in modeling the brains of animals to make machines more useful - with language. We're getting there!

Joined June 2010
97 Photos and videos
When different people work on the same problem, they get similar models. In Patom theory, a brain only has two patterns - sequences and sets. Sequences gives us time, motion and causality. Sets give us sensory recognition at a point in time. @TrueAIHound uses spiking neurons to represent events. It is music to my ears to get away from word vectors and other statistics when vision, hearing and movement are better addressed with sequences of large numbers of precise considerations.
"The AI community don't know the first thing about intelligence." What does this mean? It's no secret (except to the fake-AI community apparently) that the most important principle of intelligence is the precise timing of discrete sensory events (i.e., physical changes or phenomena). This is the reason that biological brains use spiking neurons. A spike is a temporal marker that indicates that a discrete event just occurred. This doesn't mean that we need to emulate biochemical spikes in a computer. What matters is the detection of discrete events and their relative timing: they are either concurrent or sequential. This is the basis of intelligence imo. It requires embodiment in the real world.🤔
2
1
5
1,205
The observations in psychology are helpful. We can’t draw a perfect rendering of things we know well (eg draw a dollar bill from memory). But we can recognise one when we see it! Recognition only needs to be good enough to identify accurately its source.
75
The philosophical comparison is simulation versus duplication. Today, travel for example is much easier to simulate than duplicate. In a simulation we easily travel between stars but we cannot start to duplicate that travel. While competition is focused on today’s limited artificial neural networks the limitations exclude duplication.
It's total BS to claim they are incentivising new approaches or trying to bring attention to AGI. Non-language benchmarks can be a good system test, but they don't encourage good system design.
1
1
125
The ultimate question about today's AI is why it gets compared to an intelligent being when it is made of human defined statistics. And then it is said to cover ALL use cases! That is the ultimate goal of strong AI defined in the 1950s that remains unsolved despite the claims. By focussing on domains that work with statistical models and that can tolerate errors, applications that have value can be developed. But I guess the value of that subset is too limited to create high-value companies.
Replying to @jbthinking
100% agree, the hype is massive and misleading. Once we understand we can't trust, we can focus on the parts where creativity, discovery is amplified by AI. But the discovery phase must be followed by a validation phase, and this has to involve humans with domain expertise.
1
1
150
The alternative model is that the money lost on endless training of AI systems that don’t provide value and are loss making will go back to models that are profitable for very narrow use cases. Today’s AI will be a warning to others not following scientist principles. The hype around systems that are fictional will go the way of other false starts to scientific models.
For the next couple years at least, the entire AI industry is going to be defined by this fact: demand is going to wildly outstrip supply, and so what matters is which companies / products have margin to pay for tokens. Those products will then rapidly improve because latency drives retention, and retention creates data to spin flywheels that improve the product and drive more adoption.
1
2
129
"human value is not just accuracy." And worse, today's AI is not accurate, anyway. Perhaps that's why Wozniak is disappointed? And at the same time, other CEOs from Silicon Valley are claiming that this year, agents will show amazing capabilities. After 3 years of this "AI-revolution," perhaps it is time to just stop all the predictions. They are not coming true anyway. Instead, let's see what happens and talk about what they can do, not predictions of what they might do in the 1-3 year future.
Steve Wozniak reportedly says AI keeps disappointing him, and that is why he barely uses it. Wozniak is also pointing at something deeper: human value is not just accuracy, since people bring judgment, tone, emotional context, and a sense of what matters. So when AI feels “too perfect” and “too dry,” the problem is not style alone, but a gap between language generation and human understanding. --- techspot. com/news/111806-steve-wozniak-disappointed-lot-ai-rarely-uses.html
1
2
120
Again critical thinking is useful in new ventures. How does a statistical text generator solve science problems? Dos anyone other than ai ceos believe that science is the manipulation of word sequences or instead the interactions of real world entities? Describing gravity in words is less powerful than newton’s f=ma because the equation tells a very clear story of motion at low speeds compared to light.
Altman has lost the plot. He's recycling the "AI will find new cures for diseases" hype from 2024 that crashed so badly. Plus - without seeing the contradiction - he's trying to recycle the opposing hype-pitch, that AI is so powerful it's a threat. Sloppy thinking.
1
1
3
142
If AGI is here as NVIDIA claim, wouldn't chatbots work? Surely chatbot interaction is many steps below a bot at human level? In my article today, I step through an interaction with an Australian bank, one of the global banks, to show how a simple transfer of fees cannot be handled by its system, and sends users to the call center - eventually. Conclusion: human-level AI is a long way away from current systems as they fail and connect users to humans to resolve.
2
1
104
This is typical of an interaction with a world-leading chatbot. What is the point in dealing with an error prone, untrustworthy system. The statistical text leaves out the exclusions that are important in business communications! No problem to CBA. Notice that the bank makes it YOUR JOB to find out if the responses are valid:
26
Let me fix this: "We used to retrieve information. Now we generate it in real time." Fixed: "We used to retrieve information. Now we generate HALLUCINATIONS in real time." AND "systems that think in context." Fixed: "Systems that GENERATE STATISTICAL TEXT BASED ON LOSSY REPRESENTATIONS." LLMs don't THINK. They don't use human-like context.
📁 Jensen Huang, CEO of NVIDIA, says computing has fundamentally changed. We used to retrieve information. Now we generate it in real time. From file based systems… to systems that think in context. And that demands far more compute.
2
306
Why are LLMs AGI (not). The historical figure is Julius Caesar, but people would confirm that's what it means, first. The LLM just choses the probable, and wrong in this case, possibility. Note in the quote, he said it yesterday. That means, where I am, Tuesday. The text gets the day wrong from a simple English sentence. The translation of "he came,..." is not the Latin from the historical figure (I came, ...). So there are similarities, but terrible errors that humans don't make. The errors in recognizing current context is one of the failures of LLMs currently a design flaw with that kind of 'AI.'
1
50
This is the link to the full article: substack.com/@johnatpat/note…

22
Science is most effective when given a reason for your thoughts. "That branch of AI is lethal!" If it were true, then there would need to be discussion. Will intelligent machines, once they can move and talk like us, be a danger? Why would a machine that is like us become a danger, unless people give them the ability to make decisions without supervision?
Renowned US astrophysicist Neil DeGrasse Tyson (@neiltyson ) calls for an international treaty to ban superintelligence. "That branch of AI is lethal. We've got do something about that. Nobody should build it."
1
2
74
John Ball retweeted
Replying to @ChombaBupe
Not entirely correct @ChombaBupe . Cognitive scientist @jbthinking has a working implementation for Language understanding on a machine from his brain theory. We agree today’s generative AI has more to do with dangling carrots than brain emulation.
1
1
1
46
AI Improves with Cognitive Science - Part 2 This incorporates the analysis of the science of brains to show why AI struggles with brain-like function: Moravec's paradox. The answer to how the brain processes information is answered: it doesn't. A different model that distributes a representation of the world is explained in steps. The next article can then use this to explain how human language performs some of the impressive tasks of generalization and understanding. The issue to solve comes from how computers work. Encoding data and processing it with a program is alien to what a brain does. How would a binary code be created to represent vision or hearing, for example? Brains are more capable than our best machines today. We talk, move around and use languages that seem to be coded in a way our best scientists have failed to emulate. But that just comes back to how our brain works. Brains aren't based on mathematical models. Today's article will be a chapter in my upcoming book, but for now as is the goals of science, please read the article and criticise its ideas if you can. I expect it will be hard to criticise because the model has been used to build a working parser that operates in real time, on a computer, that uses the model as described. It converts the meaning of words and phrases into related representations aligned with the world's languages (refer to the RRG linguistic model). The article explains what a pattern is, how patterns can be manipulated with exquisite detail as we see in human interaction aacross all our sensory modalities, how motor control works with the same brain material, and how this model can be extended to create language. The hard work comes from the animal brains that evolved to human brains. When we refer to someone's face, you can almost see them and it doesn't get confused between other people's. What magic does that without data or labels. It's automatic and what brains do!
1
2
83
It seems strange to take what animals do from very early life and seek to learn with simulations instead. It’s better to accept that machine learning is the wrong approach and therefore seeking data to train on it is unnecessary. There has been a lot of effort to get ML to handle robotics but the better approach is to use science and create better models.
Me: How does one solve spatial intelligence? Fei-Fei Li: By creating 3D world simulations. Me: I see. Well, good luck with that. 🙄 PS. It's a good thing babies don't need a 3D computer simulation to gain spatial intelligence, isn't it? The real world is free and perfect. 😀
1
2
109
John Ball retweeted
Me: How does one solve spatial intelligence? Fei-Fei Li: By creating 3D world simulations. Me: I see. Well, good luck with that. 🙄 PS. It's a good thing babies don't need a 3D computer simulation to gain spatial intelligence, isn't it? The real world is free and perfect. 😀
Want more editable controls when creating a true 3D world? All users of Marble can now enjoy the Advance model! Try to add a scene outside of the windows, change the vibe of the entire room, or add whatever plants you like, or make many variations of the same scene. Happy creating!🤩
3
2
15
917
AI Slop isn't the right term. It's really AI garbage. Here's an example of its lack of comprehension in Copilot. Read the article in my next comment, but here's the hard-to-read summary: o I told it my mongodb driver levels. Copilot told me these levels are compatible. (I knew they weren't since the node-drivers went unsupported in 2020, but the c# drivers were the latest in Nov 2025) o I then said that mongodb version 7 was a problem. It said "that changes everything" and NOW the system won't work. o Copilot told me my c# versions were invalid. (shocking to read it as it is untrue) o I validated my levels, and it told me I'd made a mistake o I disagreed, so it told me how to find my mistake o After giving it confirmation, it said I was CORRECT o It told me that changes made in 2025 were the culprit (no, it was in 2024) o I moved to the node application. It said to be compatible with my obsolete node version, I needed to use mongodb driver v6.13 o I added that version and it failed as node would not allow it o I told copilot that generated: 'despite earlier assumptions' it is not compatible, so use driver v5.9. That didn't work either. o It told me to use v4.0.0 which did load. o I then asked for the latest v4 driver that is compatible. It told me v4.17.2. Eventually, through trial and error, I installed one that worked. o I repeated this for mongoose, a wrapper for mongoDB with similar versioning issues where copilot did not help (answers continued in error).
1
2
91
The full article is here: johnsball.substack.com/p/not…

1
30