AI will hit a wall in the back office: Trust
Air France 447 didn't fall because the pilots lacked software. It fell because three iced-over pitot tubes fed the cockpit bad data. The instruments lost contact with reality, and the automation trusted the lies.
The answer was not more automation. It was better sensing: redundant, heated signals the system could trust before it acted.
Without verifiable inputs, finance is just processing fiction at machine speed.
Compliance, KYC, underwriting, market surveillance, credit risk. All still running on PDFs, screenshots, exports, and hand-assembled attestations.
So we layer agents on top:
read the PDF, click the portal, fill the form, route the exception.
It still doesn't know whether the underlying claim is true.
AI makes the cockpit faster. It does not fix the pitot tube.