shipping AI agents to the enterprise? here's 3 challenges I'm seeing the most in working with AI startups
1. model data boundaries - many enterprises wont send data outside their environment to hosted models. That means you wanna support BYO models in AWS/Azure, or bundle an OSS model like llama in your app
2. app data boundaries - similarly, enterprises need control over the data that agents store between llm calls - memory, context, rag, etc - that means shipping your app into their datacenter (be it AWS, Azure, GCP, on-prem) - VM images, docker compose, are common here, but k8s tends to be preferred by ENTs
3. oversight and compliance - if your agent is going to do anything useful, you need to prove that critical actions are DETERMINISTICALLY reviewed by humans, and be able to surface audit trails to verify it