什么是上下文层?生产级智能体缺失的核心基础设施 AI Engineer 2026-07-14

IQ与实效脱钩:智能时代的上下文局限

在智能时代的曙光期,大模型的认知智能(Cognitive Horsepower)正以惊人的速度呈指数级增长。然而,令人困惑的现实是,这种智能的爆发并没有同等转化为现实中的商业生产力。数据显示,目前仅有五分之一的 AI 用例能够成功投入生产,高达 56% 的 CEO 表示 AI 尚未给企业带来直接的财务收益。这背后的根源在于我们忽略了人类世界衡量工作表现的底层逻辑:智商(IQ)对实际工作表现差异的解释力仅占 10%。在真实的工作场景中,真正决定绩效的是实际产出的成果,而绩效是智能(认知算力)与上下文(Context:在岗学习中积累的业务背景、知识与技能)共同作用的函数。在过去十年中,AI 的智能维度实现了成千上万倍的增长,但作为企业独特资产的业务上下文(包括散落在仪表盘、Slack 讨论和随时可能离职的分析师脑中的 situated knowledge)却几乎停滞不前。因此,如何帮助 AI 构建并理解企业的业务上下文,成为了智能代理迈向生产力落地的下一个核心前沿。

Original English Source

Hi everyone. Uh my name is Praalpa. I'm the founder of Atlan. Um and uh today I'm going to talk about this thing where context is having its moment. Uh and so my goal today is to talk about like WTF is the context layer. Um, just before I start, and I promise this is the last time. Um, I don't know if the clicker is working. Atlin, we it's it's working. Yeah. Thank you. Um the problem we solve is we say AI doesn't know your business. We fix that. We work with an incredible group of companies around the world ranging from GitLab and Zoom and Discord and Affirm to large enterprises like Mastercard and General Motors. Um and about a year ago, uh my co-founder and I went on stage and we said, uh at the dawn of the internet era, Bill Gates had written this very famous blog post and it said content is king. Um and as we or the dawn of the agentic era, context will be king. Um since then it feels like 2026 is the year of context. context graphs anyone um uh you know every every two days you see some version of context uh popping up and so what is going on um I believe the answer to this kind of is in this reality distortion field that we live in uh I live here in the Bay Area every day or two I have conversations with people which kind of go like how far are we from AGI and we have a debate and we're like well one year three years so on uh There is no doubt that the models are getting exponentially smarter by the day. Uh two years ago they couldn't pass the bar. Today if they were to take the bar it was they're the top 1% of test scorers. On the other hand they're not exponentially more useful by any benchmark. Uh one out of five you know AI use cases actually make it to production. U you know 56% of CEOs say that there's zero financial benefit from AI today. So what's going on? I believe hidden in plain sight is actually um how performance is measured in the human world. Uh cognitive intelligence doesn't really determine real world effectiveness. Uh in fact only 10% of job performance variance is explained by IQ. Like just think about it. Would you say your smartest um you know teammate who scored the highest on the SATs is also your best teammate or would you say no it's the person who works the most and takes the most feedback and learns the fastest in the real world we care about performance and performance is outcomes that you deliver in the real world and performance is a function of two things it's a function of intelligence which is cognitive horsepower that's what the model benchmarks measure every day But it's also a function of context. This is what they say in the human world as learning on the job, right? Knowledge and skills and expertise that you learn over time. And in the last decade, uh we have compounded on one of those parameters. Uh intelligence has thousandxed in the last decade. Just in the last 6 months, we have 2xed on that axis. On the other hand, context, the situated knowledge of your business, that's barely moved. We've moved some data to the cloud uh but that's about it. It's otherwise logged in dashboards and Slack threads and uh the head of that analyst who might be leaving next week. Um and so the question ahead of us and I really believe this is the next frontier is how do we help AI build context about our business?


拆解Maya模型:人类如何内化业务上下文

为了理解如何为 AI 注入上下文,我们需要回溯人类员工掌握业务的路径。以虚拟的 Mech Context Burgers 快餐店明星数据分析师 Maya 为例,当加盟商提出一个看似简单的问题——“为什么我这周的无接触点餐通道(drive-thru)等待时间变长了?”时,Maya 需要调动极度复杂的背景知识才能给出准确解答。首先,她必须明确基本事实与规则(如确定特定业务部门口径、统计周期的起止时间、以及时区定义等);其次,她需要运用专业的诊断技能和经验(如识别 Q3 季节性天气模式的影响,或排查上季度发布的新产品是否干扰了流程);最后,她还要遵循组织行为规范,根据提问者(finance 还是 ops 团队)来定制报告的呈现方式。Maya 并非一入职就精通这些,她是通过岗前培训、影子学习(Shadowing:观察资深同事的作业流程)、在犯错中总结教训、接收经理的反馈以及处理各种复杂边缘案例,才逐步将这些琐碎的上下文内化。这种人类通过实践建立的复杂上下文框架,正是我们需要映射到 AI Agent 身上的终极蓝图。

Original English Source

Um, and every time I'm faced with a question about how do we help AI do this, I always like to go back and understand how did we help humans do this? Uh, so I'm going to take you into the life of, you know, a u exemplar employee Maya. Uh, let's say she's a data analyst at Mech Context Burgers because I thought I was going to be creative and I'm not very creative. Um, and you know, let's say she's that analyst that everybody, you know, pings in your company. Uh, right? She's the person that everybody sends a message to every morning when they're trying to solve a problem. So, let's say this morning, uh, there's a franchisee owner who sends her a message and says, "Why is my drive-thru time up this week? Why is this metric up this week?" Sounds like a really simple question. Um, but it's actually a really complicated question to ask. Just to answer this one very simple question, Maya first needs to know uh what is drive-through time uh and who's asking? Is it finance or is it you know my ops team? And it might mean different things. Uh but not just that, what does this week mean? Is the cutoff period Monday to Sunday? Is it Pacific time? Is it Eastern time? Uh that's knowledge. Like that's facts. That's the map of the business. Um but not just that. Uh there's expertise uh right there's um you know a diagnostic playbook. What what does a great analyst do? They know that you know quarter 3 is a season seasonal quarter because of weather patterns and they know to go check if the reason there's a spike is because of seasonality. They also know that the company launched a product uh just that previous quarter and so they know to check if that's why the root cause analysis failed. Uh this is expertise and skills that people pick up over time as they learn on the job. Uh and then there's norms, right? Um there's, you know, persona scoping. Who's asking the question? How do I answer this question? Um and Maya, she's one of those like cool people. She nails it. She sends an answer not just with the answer, but with the why and the root cause, and she finds the reason for it. How did Maya learn to do this? Um she just joined the company a year ago. Um first Maya you know has for like she joined and she got some training like all of us do but that's not where any of us learn right in our companies. How do we learn? We learn because you shadow like the best teammate and then you see why they're doing something and then you learn from that and then you make a mistake. Who here has learned more from a mistake than anything else? Right? You make a mistake and then you learn. uh you your manager gives you feedback and you learn not to do that again. You deal with an edge case and then you learn from that. That's how all of us humans learn at work.


Atlan的演进痛点:孤岛化Agent与上下文工程

在 Atlan 探索 AI 代理的早期阶段,我们尝试了基于特定职责构建专项代理的路线。我们为客户体验团队进行“待办任务”(Jobs to be Done)分析,定义了会议准备和文档撰写等易于被 AI 替代的工作,并快速构建了一系列“专属代理”,例如健康智能主管 Hermione 和财务风险分析师 Moneypenny。虽然初见成效,但在投入生产环境后,我们遭遇了严峻的瓶颈:

  • 上下文工程(Context Engineering):虽然创建一个代理仅需 5 分钟,但为其配置足够精准的业务上下文以保证输出的准确性,却需要耗费海量的时间,这直接导致利益相关者在遭遇错误输出时产生严重的信任危机。
  • 代理孤岛化(Isolated Islands):这些代理缺乏类似人类组织中“全员大会”那样的同步机制。当营销团队的代理更改了产品定位时,网站上的销售代理(SDR)依然在使用过时的文案。
  • 难以追踪与修复:当代理发生错误时,团队很难定位根源是底层模型、代理框架还是上下文数据。
  • 上下文混乱(Context Sprawl):由于每个代理拥有各自独立的记忆系统,导致组织内部没有唯一的真理源(Single Version of Truth)。同时,由于工具链在过去 12 个月中频繁更迭(从 Relevance AIGoogle ADKGlean 再到 Cloud Code),导致宝贵的上下文资产被锁死在各个互不兼容的系统碎片中。
Original English Source

And so then the question is how do you help build the agent Maya? Uh and now I want to walk you through our experiments and learnings as we've built this at Atlan um era one and this was roughly about 18 months ago now. Um we uh started on the the track of bootstrapping agents. Um and the way we went about it was and we started this with our customer experience team. Uh and we did this jobs to be done analysis map, right? And so we said, hey, if you are someone on our customer experience team, what are all the things that you do on a day-to-day basis? And then we made some hypothesis. We we said, you know, for example, one part of the job is documentation and meeting prep. Uh we said well AI could probably do that job pretty well. Uh and so we build a scaling factor. So on the other hand relationship management is something that our customer experience team does and we said hm that doesn't sound like something AI is going to be able to do anytime soon. And so we built a scaling factor and then we basically started bootstrapping these individual agents that were like built for that specific topic. Our team got creative. So we had Hermione who is our health intelligence lead and then we had you know money penny who was our financial risk analyst and we just made that particular agent really good at doing that one thing. Um and that worked for some time um but then we realized there were some challenges with this approach. The first context engineering uh we got to the point by middle of last year where building an agent was really easy took like 5 minutes. uh but giving it the business context that it took to actually get it to be accurate took forever. Uh quality of the agent often dependent uh on the quality of context engineering and that led to a lot of weird lost trust cases with our stakeholders. Um then as we started taking this into production we started seeing that these agents basically were kind of like living on their own island. Now imagine for example if you're in a human team and your marketing changes positioning on your you know and then they come to the town hall and they tell you that they changed positioning and so then you know the SDR on your team or your sales development rep they know that they should use that new positioning. This is like the infrastructure that we've built for humans inside our organizations. Agents didn't have them. So our marketing team had these agents and they started making changes to that and then our SDR agent on our website was still pitching the old version. We had no idea how any of these things were even connected. So we didn't even know how to like run this as as a team of agents. When an agent gets something wrong, this is hard. It was really hard to like trace back what happened. Was it the model? Was it the agent? Was it the context? Like where how do we even go back and fix this? Um and over time we started dealing with uh context sprawl. Uh we had the the the hard part about this was agents all had their own memory systems to a certain extent. So they were learning they were all learning separately and they were learning differently. It became very very difficult very quickly to say okay what does the single version of truth here look like? Um and then over time we actually went through in the last 12 months we've gone through cycles of at the agentic layer about 12 months ago we were using one of these no code type builders called relevance we went from there into Google ADK then we tried glean uh start of this year we moved to cloud code now we are kind of like 50/50 claude and codeex um and every single time as these changes happened uh our context got trapped in each of these individuals systems.


构建统一上下文层:从系统连接到“公司大脑”的逆向重构

面对前述挑战,我们将关注点从孤立的代理转移到了“团队协同”上。团队之间的默契源于共同的语言、共享的事实图景、一致的执行手册以及持续的学习闭环。我们的营销团队进行了一项关键实验:通过上下文层(Context Layer)作为枢纽,将数据系统、社交平台、广告账户和分析工具等异构数据源连接起来,使得顶尖的 SEO 专家和竞争情报专家的专业技能能够沉淀至一个公共知识库中。然而,在这个“活体大脑”的构建中,单纯存放文档是远远不够的,它还必须包含:

  • 数据图谱:指导广告代理在进行日常分析时应该调取哪张数据表。
  • 业务指标定义:明确诸如 ARR(年度经常性收入:Annual Recurring Revenue)或“合格线索”的具体计算方式和业务语义。
  • 组织实体结构:映射公司内部的实体关系与组织架构。

对于大多数企业而言,上下文往往在 SalesforceHubSpot 到数据仓库与应用层之间的多次数据流转(Hops)中丢失。Atlan 的实践表明,通过将这些业务系统互联,并利用 AI 沿着业务节点进行逆向重构(Reverse Construction),能够极其高效地自动梳理并构建出第一版高可用的“公司大脑”。

Original English Source

So started this year as general purpose agents started to become a thing, we said, what if there was a different approach with general purpose agents. Um, again going back to the human world, well Maya, she's not an individual star. She's part of a team, right? And you know, you talk about these dream teams like Maya and someone who runs customer support and someone who launches ads. These people work really well together. And often these dream teams are built on shared context, right? Uh they have a shared language. Uh they have a shared picture of what's true today. They have shared playbooks. Uh they have shared norms, who's allowed to make what decision. Uh and then they learn together. I think this is the most important part of it. They have compounding learning loops of what good looks like. uh and they have shared memory that you know oh we launched this thing last quarter and it like was terrible and we're not going to make that mistake again right and so we said is there a way to bring that into the way we think about AI in our companies and so the mental model we started working on was we said okay we have these teams of humans and they're across the board and can these people essentially start building domain skills so each of them is responsible for a certain set skills. All of this goes into this common one place which is this one company brain of sorts, right? I like to think of this as the context layer. Uh and then this has a bunch of retrieval mechanisms which then talks to the general purpose agent across the ecosystem. So then we started an experiment. Uh this is some version of what our marketing team ended up building. So you'll see on the left those are all the systems that our marketing team uses. So data systems, our social and community platforms, our ad platforms, our analytics platforms. Um and then you'll see this agent block. Uh we built this very specifically for um having openness. So we had claw code and co-work. We also had our own claw that we deployed which has you know essentially talks in our slack channels. Um and then we used some external products like qualified and artisan. Uh in the middle is kind of this context layer that our team started building. So think of it as our best SEO person was building their SEO skill. Uh our best competitive intel person was building the best competitive intel skill and that kind of became this common repo that we were building into and pulling out from. This sort of became our living brain. Over time, we realized there were some things that we needed in this brain, right? Uh we realized we needed a data graph like if for example our autonomous ads agent, we realized it needs to do analysis on a daily basis. So like which table should I go pull from? Uh we needed a library of skills. We also needed some other things, semantics, metrics, what is ARR, how do you measure that? Uh what is a qualified lead in our company? uh and or structure entities things like that. Over the last 6 months, we ended up creating about 300 skills and 40 agents in this team. Uh which has been incredible. Uh but then with this approach too, we realized that there were some challenges. We realized that context kind of needs to be managed like code. ... And the third often a lot of people ask me this question which is like how do I start because my business is like really disperate and I have all these like 60 systems and how do I even start? One of the biggest learnings we've had is context is hidden in these in business systems. Uh and across this context quality can really compound. So for example, if you're able to connect your Salesforce and your HubSpot to your data warehouse to your application layer and then you're able to reverse construct how these things are actually connected one to another, context today gets lost in every one of those hops. But if you can reverse construct that and then deploy AI on top of it, we've seen incredible accuracy in being able to reverse construct the first version of your company brain.


像管理代码一样管理上下文:未来的Git与企业独特性壁垒

随着代理规模增长至数十甚至数百个,硬编码上下文的传统做法将变得完全不可持续。上下文层必须演变成一套类似代码的管理系统,即实现上下文的生命周期管理。我们需要思考“用于上下文的 GitHub”应当具备哪些特征:

  1. 依赖管理与版本控制:以技能(Skills)为例,当竞争情报技能更新时,会直接影响定位技能,进而波及销售话术技能。我们需要清晰的依赖图谱以及人工与 AI 协同的工作区,来确保上游变更不会意外破坏下游代理的行为。
  2. 安全与治理:杜绝在环境变量文件中硬编码敏感密钥,并对公共技能仓库的引入进行严格的姿态管理(Posture Management)与安全审计。
  3. 自我改进的闭环:通过部署专用的 Trace 分析工具,AI 能够读取系统运行的轨迹,并将其反向推导反馈给维护者进行“批准/拒绝”的循环,从而实现自动纠错和持续迭代。
  4. 多模态检索与交互:支持通过 MCP(Model Context Protocol:模型上下文协议)、SQL、向量检索和混合组装等多种形式,将这些机器可用的结构化上下文实时交付给大模型。

在所有人都能访问相同大语言模型的时代,决定企业终极壁垒的不再是底层智能的差异,而是企业独有的业务逻辑、规范与文化。上下文层正是将这些无形资产编码为机器可用信息的底层新型基础设施。

Original English Source

Um so some challenges, let's pick skills. uh dependency management became really complicated. So for example, we have this comparative intelligence skill and it learns from the market on what's changing in the market and it improves. Um it feeds our category positioning skill which then feeds our sales battle card skill. Uh now each of these skills is learning and evolving. Uh but every time they learn and evolve it breaks something downstream. uh and these skills very quickly start getting outdated and start drifting. Uh who owns skill quality became another thing like who eventually owns the quality of this security and governance was a nightmare. Uh we had secrets hardcoded in ENV files. Uh it was people were downloading these public skill repos. This the whole thing was like a nightmare. Um and then I talked about context portability across all these multi-agent systems. I started this talk by saying WTF is a context layer. Uh these are the problems that a context layer is meant to solve. Um the question I like to ask is what does the GitHub for context look like? Um few thoughts. Uh company context needs life cycle management, collaboration and versioning. Uh just like code does. uh you know there's questions like what's local context what's global context how do I keep this updated so on uh some thoughts in this can skills have a profile just like code does uh can that have a self-learning learning loop that's baked into it uh what does quality management look like can you have security and postures posture management associated with that that's really like the first step uh I see this as like having something that has built-in versioning and quality and dependency management. So you should be able to say, "Hey, this thing impacts all these other things. This is the approver. This is the maintainer. These are the contributors. How do you build like kind of human plus AI workspaces that these that these skills uh are managed via? Second thing, every AI interaction creates more context and harnessing this uh is gold. uh uh there's been I know a lot of talks about self-improving loops uh we have found that with traces deploying a specific harness that actually is specialized in being able to go and reverse construct from that. So think of it as AI that's reading through all your traces and almost brings it back to your maintainer loop and says approve reject approve reject improve this over time. Uh that's the compounding learning loop. ... So I'll end with this. Uh the way I think about a context layer is it's a system that turns knowledge and expertise and norms that we talked about that Maya knows into a machine usable context for AI systems. Um at a very high level the way I like to think of it is it looks like this. Uh it continually is mining context from your business systems. It's feeding this in to that one company brain. It's harnessing this in skills and context development life cycles as your teams go and deploy these agents. And then it has a bunch of ways you can retrieve it. So MCP, SQL, vector retrieval, hybrid assembly, all these different ways that you retrieve it and pull back from traces and build this compounding learning loop. Today we're largely building agents by hard- coding context. The scale of this problem I truly believe is unhived because with scale this can become really unsustainable. Uh and a little dangerous like all of us know this this old joke which is if you ask sales and finance the revenue number you're going to get two different numbers. uh we're fast approaching a moment of starting to deploy autonomous systems where the same thing is starting to happen. So I'll end with one last thing. I started this presentation by saying context is king. Um I'd like to end it by saying context is also IP. Something I think a lot about is in a world where you and your competitor have access to the same models and the same intelligence, what differentiates a company? What differentiates a customer support agent at American Express versus Amazon? Uh that's how you do business. That's what makes your company special. uh context is how we take and encode our culture and our norms into something that we will be proud of as we build autonomous frontier firms. Um and that's all I had. Um you can find me at proalpa on Twitter um or write to me. We are actively working with folks on the frontier ongoing and shipping and building company brands. Um so if you'd like to talk to us, feel free to reach out. Thank you.

📌 文中提及的人物和组织

公司/组织: Atlan, Mastercard, General Motors

产品/模型: Claude, Salesforce, HubSpot

关键字: context-layer ai-agent production-deployment knowledge-management multi-agent-system