🚩 RLHF makes AI assistants inherently more prone to bullshit!
In our marketplace experiments, no matter what facts the AI knows, it insists the products have great features most of the time.
⚠️ That's bullshit: claims made with no regard for truth, just to sound helpful. (4/n)