✽ Securing autonomy / fmr VP Product @TrustVanta / Founder @trustpage (acq Vanta), @Ambassador (acq West), @Fetchnotes (acq Drift)

Joined January 2010
114 Photos and videos
Nathan has always made great things and this is no exception. Been using for a while and it’s become a core component of my daily work.
Introducing Roughdraft! A new open source project designed to make collaboration with agents better. The idea is to bring commenting and suggested changes to markdown (e.g. plan docs) in a nice interface. Free, local, etc. 👉 roughdraft.md 👈
2
2
359
Go Blue!
The Kings of College Basketball 〽️
1
84
Chase Lee retweeted
I am coming around to the fact that MCP, done right, can be magic.
185
47
1,097
154,225
We haven’t considered reports and certs from Delve valid for several months. Meaning, if you used them to get a SOC 2 report, we do not look at you as having one. And if you got a 27001 cert, recertifications don’t count. You need to start the process over.
There’s been a lot of allegations against Delve. But we haven’t been able to share our side of the story until today due to ongoing cybersecurity and forensics investigations. Maintaining customer trust is central to everything we do. That said, we grew too fast and fell short of our own standard. To our customers, we deeply apologize for the inconveniences caused. We take these allegations seriously and have made changes: a new auditor network, free re-audits and pentests for all customers, enhanced transparency in audit communications, and more. However, we also want to set the record straight on the anonymous attacks. The evidence we have points to a targeted cyberattack from a malicious actor, not a “whistleblower.” We believe the attacker purchased Delve under false pretenses, exfiltrated internal company data, and used it to launch a coordinated smear campaign. The posts rely on a mix of fabricated claims, cherry-picked screenshots, and stolen data taken out of context. See the link in the comments for more details. Delve was built to modernize compliance. We are not going anywhere and are committed to building what's next.
1
156
Chase Lee retweeted
Delve, a YC-backed compliance startup that raised $32 million, has been accused of systematically faking SOC 2, ISO 27001, HIPAA, and GDPR compliance reports for hundreds of clients. According to a detailed Substack investigation by DeepDelver, a leaked Google spreadsheet containing links to hundreds of confidential draft audit reports revealed that Delve generates auditor conclusions before any auditor reviews evidence, uses the same template across 99.8% of reports, and relies on Indian certification mills operating through empty US shells instead of the "US-based CPA firms" they advertise. Here's the breakdown: > 493 out of 494 leaked SOC 2 reports allegedly contain identical boilerplate text, including the same grammatical errors and nonsensical sentences, with only a company name, logo, org chart, and signature swapped in > Auditor conclusions and test procedures are reportedly pre-written in draft reports before clients even provide their company description, which would violate AICPA independence rules requiring auditors to independently design tests and form conclusions > All 259 Type II reports claim zero security incidents, zero personnel changes, zero customer terminations, and zero cyber incidents during the observation period, with identical "unable to test" conclusions across every client > Delve's "US-based auditors" are actually Accorp and Gradient, described as Indian certification mills operating through US shell entities. 99% of clients reportedly went through one of these two firms over the past 6 months > The platform allegedly publishes fully populated trust pages claiming vulnerability scanning, pentesting, and data recovery simulations before any compliance work has been done > Delve pre-fabricates board meeting minutes, risk assessments, security incident simulations, and employee evidence that clients can adopt with a single click, according to the author > Most "integrations" are just containers for manual screenshots with no actual API connections. The author describes the platform as a "SOC 2 template pack with a thin SaaS wrapper" > When the leak was exposed, CEO Karun Kaushik emailed clients calling the allegations "falsified claims" from an "AI-generated email" and stated no sensitive data was accessed, while the reports themselves contained private signatures and confidential architecture diagrams > Companies relying on these reports could face criminal liability under HIPAA and fines up to 4% of global revenue under GDPR for compliance violations they believed were resolved > When clients threaten to leave, Delve reportedly pairs them with an external vCISO for manual off-platform work, which the author argues proves their own platform can't deliver real compliance > Delve's sales price dropped from $15,000 to $6,000 with ISO 27001 and a penetration test thrown in when a client mentioned considering a competitor
A detailed and brutal look at the tactics of buzzy AI compliance startup Delve "Delve built a machine designed to make clients complicit without their knowledge, to manufacture plausible deniability while producing exactly the opposite." substack.com/home/post/p-191…
387
719
8,134
5,683,623
Chase Lee retweeted
Mar 12

52
51
443
203,432
Chase Lee retweeted
Mar 12
we are here
Funny how MCP went from “Has issues but clearly the future but we should all jump on board” To “Bloated and unnecessary. Clearly has no future”. Without ever visiting the “useful” stage.
2
5
38
5,940
Clawdbot is a live case study of what happens when agents meet our current security stack. Exposed instances. Prompt injection via email. Credential leaks. One-click RCE. 170k stars, massively viral, and a security model that can't keep up.
2
3
17
2,851
Today I'm back to being a founder, heads down with a team building the answer. I've been calling this space autonomous runtime security: real-time intelligence and enforcement for systems that act on their own.
1
6
152
Autonomous tech can drive real progress — but only if we can secure it. If you're building or using agents and struggling to secure them, I'd love to chat.
3
107
Chase Lee retweeted
31 Dec 2025

212
811
8,353
4,037,976
Chase Lee retweeted
30 Dec 2025
yes things are changing fast, but also I see companies (even faang) way behind the frontier for no reason. you are guaranteed to lose if you fall behind. the no unforced-errors ai leader playbook: For your team: - use coding agents. give all engineers their pick of harnesses, models, background agents: Claude code, Cursor, Devin, with closed/open models. Hearing Meta engineers are forced to use Llama 4. Opus 4.5 is the baseline now. - give your agents tools to ALL dev tooling: Linear, GitHub, Datadog, Sentry, any Internal tooling. If agents are being held back because of lack of context that’s your fault. - invest in your codebase specific agent docs. stop saying “doesn’t do X well”. If that’s an issue, try better prompting, agents.md, linting, and code rules. Tell it how you want things. Every manual edit you make is an opportunity for agent.md improvement - invest in robust background agent infra - get a full development stack working on VM/sandboxes. yes it’s hard to set up but it will be worth it, your engineers can run multiple in parallel. Code review will be the bottleneck soon. - figure out security issues. stop being risk averse and do what is needed to unblock access to tools. in your product: - always use the latest generation models in your features (move things off of last gen models asap, unless robust evals indicate otherwise). Requires changes every 1-2 weeks - eg: GitHub copilot mobile still offers code review with gpt 4.1 and Sonnet 3.5 @jaredpalmer. You are leaving money on the table by being on Sonnet 4, or gpt 4o - Use embedding semantic search instead of fuzzy search. Any general embedding model will do better than Levenshtein / fuzzy heuristics. - leave no form unfilled. use structured outputs and whatever context you have on the user to do a best-effort pre-fill - allow unstructured inputs on all product surfaces - must accept freeform text and documents. Forms are dead. - custom finetuning is dead. Stop wasting time on it. Frontier is moving too fast to invest 8 weeks into finetuning. Costs are dropping too quickly for price to matter. Better prompting will take you very far and this will only become more true as instruction following improves - build evals to make quick model-upgrade decisions. they don’t need to be perfect but at least need to allow you to compare models relative to each other. most decisions become clear on a Pareto cost vs benchmark perf plot - encourage all engineers to build with ai: build primitives to call models from all code bases / models: structured output, semantic similarity endpoints, sandbox code execution. etc What else am I missing?
I've never felt this much behind as a programmer. The profession is being dramatically refactored as the bits contributed by the programmer are increasingly sparse and between. I have a sense that I could be 10X more powerful if I just properly string together what has become available over the last ~year and a failure to claim the boost feels decidedly like skill issue. There's a new programmable layer of abstraction to master (in addition to the usual layers below) involving agents, subagents, their prompts, contexts, memory, modes, permissions, tools, plugins, skills, hooks, MCP, LSP, slash commands, workflows, IDE integrations, and a need to build an all-encompassing mental model for strengths and pitfalls of fundamentally stochastic, fallible, unintelligible and changing entities suddenly intermingled with what used to be good old fashioned engineering. Clearly some powerful alien tool was handed around except it comes with no manual and everyone has to figure out how to hold it and operate it, while the resulting magnitude 9 earthquake is rocking the profession. Roll up your sleeves to not fall behind.
164
413
5,205
1,285,673
Chase Lee retweeted
Today we launch the Agentic AI Foundation (AAIF) with project contributions of MCP (@AnthropicAI), goose (@blocks) and AGENTS.md (@OpenAI), creating a shared ecosystem for tools, standards, and community-driven innovation. Learn more about this major step toward: hubs.la/Q03Xvw3v0
32
140
412
170,266
9 Jan 2024
GO BLUE
IT’S GREAT TO BE A MICHIGAN WOLVERINE! #GoBlue
3
693
Chase Lee retweeted
Some awesome in-product marketing I saw in my @TrustVanta dashboard this morning Tells users how much-existing data/policy converts to getting certified in a new compliance category makes it stupidly easy to get in touch with their sales team
2
2
9
2,157
Chase Lee retweeted
2 Sep 2023
When people copy you, the best strategy is usually to ignore them. People who copy you are (a) unoriginal and (b) opportunists, and those are both strong predictors of failure. If you wait them out, they'll eventually drop away.
292
552
4,295
1,817,569
Chase Lee retweeted
4 ways for validate your B2B startup idea: 1. The do-it-manually path @christinacaci manually created compliance reports for a few companies and noticed (surprisingly) that they all found them very valuable. She then built @TrustVanta (last valued at $1.6B):
12
62
517
178,266