I’ve recently accepted the Programme Director role at ARIA, taking over from davidad in running the Safeguarded AI programme.
🧵 about the programme’s strategic vision our upcoming funding efforts in cybersecurity we're hiring!
A new web page for my book! tomasp.net/cultures/
It has all the links you need to get the open access PDF, buy a hardcopy or an ebook, as well as some older talks.
If you run a podcast, conference or a user group, I'm always hapy to join & talk about something from the book!
The open access version of Cultures of Programming is now available online. Just in time for the holiday break!
Read it here: cambridge.org/core/books/cul…
If you prefer a real book, use PETRICK26 for a 20% discount (valid until January 31) at: cambridge.org/9781009492348
A paper that seeks to extract concepts from an AI chess player that are currently beyond human experts, but are still teachable:
pnas.org/doi/10.1073/pnas.24…
Having extracted the most powerful novel AI concepts as vectors, they look to see if these are outside the human range
Some reflections here (ncatlab.org/davidcorfield/sh…) on the extent to which may see Charles Peirce's three modes of reasoning (deduction/induction/abduction) as completions of inferential triangles.
Abduction and induction have, to be sure, this common feature, that both lead to the acceptance of a hypothesis because observed facts are such as would necessarily or probably result as consequences of that hypothesis. But for all that, they are the opposite poles of reason,
/3
Some reflections here (ncatlab.org/davidcorfield/sh…) on the extent to which may see Charles Peirce's three modes of reasoning (deduction/induction/abduction) as completions of inferential triangles.
A paper that seeks to extract concepts from an AI chess player that are currently beyond human experts, but are still teachable:
pnas.org/doi/10.1073/pnas.24…
Having extracted the most powerful novel AI concepts as vectors, they look to see if these are outside the human range
"We define the novelty score based on how well a concept vector can be reconstructed using a set of basis vectors derived from AZ’s games. A lower reconstruction loss means that the concept is better represented by the given set of basis vectors...
...In other words, we look for concepts that are better explained using AZ’s language (basis vectors) than humans’ language."
So better bases allow the easier expression of powerful concepts. Interesting.
I'd love to see this vector space approach meet with dependent type theory. There should be a way to pass back and forth between the hierarchical encoding of dependent typing and corresponding representations within a very high-dimensional space.
Fundamentally, high-level concepts group into categorical variables---mammal, reptile, fish, bird---with a semantic hierarchy---poodle is a dog is a mammal is an animal.
How do LLMs internally represent this structure?
arxiv.org/abs/2406.01506
it's mono.
If so, what do departures from isomorphism look like in this category? Do they relate to what Comolatti and Hoel have on determinism and degeneracy as generalizations of sufficiency and necessity?
But taking the first steps to go symmetric situations, are there people looking to utilise what's coming from monoid representation theory? This is notorious less simple (mathoverflow.net/q/37115/447), but there is material on the subject, such as ...
We hear plenty about methods from group representation theory being used to train neural nets to operate under conditions of symmetry. And there are people looking to push beyond to apply category theory (e.g., arxiv.org/abs/2402.15332).
But taking the first steps to go symmetric situations, are there people looking to utilise what's coming from monoid representation theory? This is notorious less simple (mathoverflow.net/q/37115/447), but there is material on the subject, such as ...
this book by Benjamin Steinberg: link.springer.com/book/10.10….
I see this is taken up in an interesting looking thesis by Sören N. Schwenker, Genericity in Network Dynamics: ttps://ediss.sub.uni-hamburg.de/bitstream/ediss/6159/1/Dissertation.pdf
Another reference to add to category-theoretic approaches to a philosophy of duality: 'Grothendieck's theory of schemes and the algebra–geometry duality'
hal.science/hal-03913076/doc…