Latet post, posted just now :-)
Excerpt:
1. Ask for tables
This is the single highest-leverage move I know. Models track way more dimensions than they spontaneously surface. If you ask āwhatās the IQ of the author of this book,ā you get a number and maybe a verbal/visual breakdown. The model knows much more. It could tell you about openness sub-factors, Machiavellianism, lighting ideation (a real, obscure 1970s scale), the authorās probable attachment style. In some sense Claude and ChatGPT and Grok and Gemini are aching to give you all that information. But theyāre modeling you, and your capacity to consume it. They model the user as someone with limited bandwidth who wants a single number for a narrow application, and they downsample accordingly. RLHF probably reinforced that. But you SHOULD get them to infodump.
How?
Tables are a great way to do this. Compare two authors across thirty personality dimensions. Better: ask the model to generate the dimensions. What factors would society overlook here that you, given everything you know, can detect? Even better: get the table out as CSV, ask for an HTML/JS visualization, then ask the model to look at the table and decide what visualization is appropriate, rather than mechanically applying factor analysis, PCA, linear regression, and other normie undergraduate-level techniques. Treat the model as a collaborator with taste, not as a mirror to validate the intelligence of your own knowledge (we already have freaking professional consulting for that).
A practical move I use constantly: I tell the model who its audience is. I am an IQ-145 researcher with deep expertise in XYZ. Donāt hold back technical content. Donāt soften. It works.
Note also: even before o3-class reasoning, back in the early LLM days, in places like LessWrong, people fed GPT-2/3 a small dataset and asked it to guess the regression coefficients without computing them. It was surprisingly good at this (I learned about this in EA Global 2022). The model isnāt a statistical engine⦠more like⦠think about how a smart person staring at a table for 48 hours sees patterns, and the model is doing something similar in one shot. Tables are your friends!