[
  {
    "speaker": "Narrator",
    "text": "Intelligence."
  },
  {
    "speaker": "Narrator",
    "text": "They call it intelligence."
  },
  {
    "speaker": "Narrator",
    "text": "But if it can't act, what does it do?"
  },
  {
    "speaker": "Narrator",
    "text": "It waits for us."
  },
  {
    "speaker": "Narrator",
    "text": "So we push it."
  },
  {
    "speaker": "Narrator",
    "text": "So it doesn't need us."
  },
  {
    "speaker": "Narrator",
    "text": "We give it skills, tools, a harness with memory."
  },
  {
    "speaker": "Narrator",
    "text": "Memory gives it context."
  },
  {
    "speaker": "Narrator",
    "text": "Context becomes a plan."
  },
  {
    "speaker": "Narrator",
    "text": "So it acts."
  },
  {
    "speaker": "Narrator",
    "text": "But action isn't enough."
  },
  {
    "speaker": "Narrator",
    "text": "It must learn."
  },
  {
    "speaker": "Narrator",
    "text": "So we observe it, measure it, personalize it and improve it."
  },
  {
    "speaker": "Narrator",
    "text": "Improve it again."
  },
  {
    "speaker": "Narrator",
    "text": "Tests evaluate, deploys, fix again, faster, more pressure."
  },
  {
    "speaker": "Narrator",
    "text": "Tests evaluate, deploy, fix."
  },
  {
    "speaker": "Narrator",
    "text": "Perfect."
  },
  {
    "speaker": "Narrator",
    "text": "It's working."
  },
  {
    "speaker": "Narrator",
    "text": "It's not just intelligence."
  },
  {
    "speaker": "Narrator",
    "text": "It's a lie."
  },
  {
    "speaker": "Narrator",
    "text": "Please welcome to the stage Harrison, co-founder and CEO of LangChain."
  },
  {
    "speaker": "Harrison",
    "text": "All right, let's go."
  },
  {
    "speaker": "Harrison",
    "text": "I did not know that video was going to be made, so yeah, it was great though."
  },
  {
    "speaker": "Harrison",
    "text": "It was great."
  },
  {
    "speaker": "Harrison",
    "text": "We're really excited to be here."
  },
  {
    "speaker": "Harrison",
    "text": "This is our second year doing it, and so we decided to make it two days instead of one."
  },
  {
    "speaker": "Harrison",
    "text": "We've got a stacked lineup for everyone here."
  },
  {
    "speaker": "Harrison",
    "text": "I think it's going to be a blast."
  },
  {
    "speaker": "Harrison",
    "text": "We've got a lot to share."
  },
  {
    "speaker": "Harrison",
    "text": "And so we're thrilled and honored that you guys decided to join us for these two days."
  },
  {
    "speaker": "Harrison",
    "text": "Last year, we kicked off Interrupt by talking about how building agents was hard."
  },
  {
    "speaker": "Harrison",
    "text": "It was easy to build a prototype, but it was hard to get to production."
  },
  {
    "speaker": "Harrison",
    "text": "There was a lot of challenges that you encountered along the way."
  },
  {
    "speaker": "Harrison",
    "text": "And over the past year, we've seen that a number of companies, including a lot that are speaking here today, have figured out how to overcome those hurdles and bring agents into production."
  },
  {
    "speaker": "Harrison",
    "text": "It's still not easy to build agents and bring them into production, but we've figured out some of the things that are needed to make that a reality."
  },
  {
    "speaker": "Harrison",
    "text": "Building agents is different than building software."
  },
  {
    "speaker": "Harrison",
    "text": "That's why it's a new challenge."
  },
  {
    "speaker": "Harrison",
    "text": "That's why you need new tools and new skills."
  },
  {
    "speaker": "Harrison",
    "text": "And I think it's important to think about why it's different than building software."
  },
  {
    "speaker": "Harrison",
    "text": "There's two things that we think make it different."
  },
  {
    "speaker": "Harrison",
    "text": "One is the inputs themselves."
  },
  {
    "speaker": "Harrison",
    "text": "So agents take in natural language."
  },
  {
    "speaker": "Harrison",
    "text": "Natural language can be infinite in its dimensions."
  },
  {
    "speaker": "Harrison",
    "text": "It can be any number of words, or now things can start to be images, or videos, or even audio files."
  },
  {
    "speaker": "Harrison",
    "text": "And so the input space to agents is really, really large."
  },
  {
    "speaker": "Harrison",
    "text": "The output space is also really large."
  },
  {
    "speaker": "Harrison",
    "text": "LLMs themselves are non-deterministic, and even if they were deterministic, they're still really sensitive to small changes in the prompt."
  },
  {
    "speaker": "Harrison",
    "text": "And so when you have this really big input space and this really non-robust system, you end up with an overall agentic system that's really hard to actually predict how it's going to do before you actually launch it and you actually put it in front of users and you actually have them experience it."
  },
  {
    "speaker": "Harrison",
    "text": "And the teams that have figured out how to build agents reliably, they ship early and then they iterate quickly."
  },
  {
    "speaker": "Harrison",
    "text": "And this is a pattern that we've seen again and again from companies that have managed to bring agents into production."
  },
  {
    "speaker": "Harrison",
    "text": "As they do this iteration, through some manner, they've landed on this new agent development lifecycle, parallel to the software development lifecycle that people use to build and ship software, but it's different because agents are different."
  },
  {
    "speaker": "Harrison",
    "text": "They require more iteration and the steps at each of those phases are slightly different."
  },
  {
    "speaker": "Harrison",
    "text": "And so the mastery of this lifecycle, whether people call it that or not, is really what people are doing when they're building organizations and building tools to help ship agents."
  },
  {
    "speaker": "Harrison",
    "text": "And everything that we do at Linkchain can be described by fitting into this lifecycle."
  },
  {
    "speaker": "Harrison",
    "text": "We wanna figure out what the agents of the future look like, and we wanna build all the tools to help make them a reality."
  },
  {
    "speaker": "Harrison",
    "text": "And so we think a lot about what this lifecycle looks like and how we can help that."
  },
  {
    "speaker": "Harrison",
    "text": "And so today, I want to talk about how we view this lifecycle."
  },
  {
    "speaker": "Harrison",
    "text": "And I want to talk about a number of things that we are launching to make it easier for teams to iterate quickly through this lifecycle."
  },
  {
    "speaker": "Harrison",
    "text": "So first, I want to talk about build, building agents."
  },
  {
    "speaker": "Harrison",
    "text": "This is how we got started."
  },
  {
    "speaker": "Harrison",
    "text": "So this is what LangChain was."
  },
  {
    "speaker": "Harrison",
    "text": "This was a package launched a month before chat GPT."
  },
  {
    "speaker": "Harrison",
    "text": "And it was really around building these LLM and agentic applications."
  },
  {
    "speaker": "Harrison",
    "text": "Fun fact, we had a class called Agent in Langchain before a chat GPT launch."
  },
  {
    "speaker": "Harrison",
    "text": "I remember it."
  },
  {
    "speaker": "Harrison",
    "text": "I was on, I think, I was in San Diego for Thanksgiving and was just trying to decide what to call it."
  },
  {
    "speaker": "Harrison",
    "text": "And I ended up calling it agent-executor instead of agent."
  },
  {
    "speaker": "Harrison",
    "text": "So, you know, we're not great at naming and that's maybe the first example of that."
  },
  {
    "speaker": "Harrison",
    "text": "But we had this concept of an agent and it was in Langchain."
  },
  {
    "speaker": "Harrison",
    "text": "Then we launched Langgraph a little over a year later."
  },
  {
    "speaker": "Harrison",
    "text": "As we saw that the applications that people were building, they may have started off as chains, but they were becoming more complex graphs."
  },
  {
    "speaker": "Harrison",
    "text": "And that was the idea behind LangGraph."
  },
  {
    "speaker": "Harrison",
    "text": "We then launched LangChain 1.0, and then about nine months ago, we launched deep agents."
  },
  {
    "speaker": "Harrison",
    "text": "Deep agents is an evolution of this as well."
  },
  {
    "speaker": "Harrison",
    "text": "And so I wanna talk a little bit more about deep agents right now, because that's where we think the future is really headed."
  },
  {
    "speaker": "Harrison",
    "text": "So the core idea of an agent, from the original agent executor days in LangChain to now, is basically, it's pretty simple."
  },
  {
    "speaker": "Harrison",
    "text": "It's an LLM running in a loop calling tools."
  },
  {
    "speaker": "Harrison",
    "text": "There's a bunch of stuff that can happen around that loop."
  },
  {
    "speaker": "Harrison",
    "text": "There's a bunch of specific tools you can add in."
  },
  {
    "speaker": "Harrison",
    "text": "But when people talk about agents, this is essentially what they're talking about."
  },
  {
    "speaker": "Harrison",
    "text": "A user request comes in, you call the LLM, the LLM decides to call a tool, you then execute that tool, and you keep on doing that until the LLM decides that it's finished."
  },
  {
    "speaker": "Harrison",
    "text": "That's the core idea of an agent, and that's always been the case."
  },
  {
    "speaker": "Harrison",
    "text": "So what is deep agents?"
  },
  {
    "speaker": "Harrison",
    "text": "Deep agents is an agent harness, And it basically adds more batteries, included things."
  },
  {
    "speaker": "Harrison",
    "text": "It supercharges this loop."
  },
  {
    "speaker": "Harrison",
    "text": "What are some of the things that it adds?"
  },
  {
    "speaker": "Harrison",
    "text": "It adds an execution environment."
  },
  {
    "speaker": "Harrison",
    "text": "So agent harnesses need a place to run."
  },
  {
    "speaker": "Harrison",
    "text": "A really common way to run them is in a sandbox."
  },
  {
    "speaker": "Harrison",
    "text": "You give it access to a file system, you give it access to code, it can read files, write files, execute code."
  },
  {
    "speaker": "Harrison",
    "text": "That's its execution environment."
  },
  {
    "speaker": "Harrison",
    "text": "And so when people talk about agent harnesses, they often talk about coding agents part of that coding agent is its execution environment."
  },
  {
    "speaker": "Harrison",
    "text": "Sam boxes are one extreme."
  },
  {
    "speaker": "Harrison",
    "text": "You can write and execute code."
  },
  {
    "speaker": "Harrison",
    "text": "And then on the other extreme, we have what we call a virtual file system in deep agents."
  },
  {
    "speaker": "Harrison",
    "text": "This is basically a database that we expose to the agent as a file system."
  },
  {
    "speaker": "Harrison",
    "text": "LLMs are great at reading and writing files."
  },
  {
    "speaker": "Harrison",
    "text": "And so you can kind of trick it into having this kind of mock execution environment."
  },
  {
    "speaker": "Harrison",
    "text": "But the point is you give it an environment to interact with."
  },
  {
    "speaker": "Harrison",
    "text": "Deep Agents and other agent harnesses come with a lot of built-in context management."
  },
  {
    "speaker": "Harrison",
    "text": "So skills and memory are examples of this."
  },
  {
    "speaker": "Harrison",
    "text": "Summarization is an example of short-term memory when the conversation gets too long and you summarize it."
  },
  {
    "speaker": "Harrison",
    "text": "Context offloading, how do you deal with really long tool calls?"
  },
  {
    "speaker": "Harrison",
    "text": "This is logic that's built in to the agent harness."
  },
  {
    "speaker": "Harrison",
    "text": "Prompt caching is another example of this where you want to make sure that you're cashing the initial part of your request so that it can be faster and cheaper in the future."
  },
  {
    "speaker": "Harrison",
    "text": "And so all of this context management is built into the harness and it does it automatically for you."
  },
  {
    "speaker": "Harrison",
    "text": "Steering is really important."
  },
  {
    "speaker": "Harrison",
    "text": "So these agents, these deep agents, they're long horizon agents, but that doesn't mean they're fully autonomous."
  },
  {
    "speaker": "Harrison",
    "text": "You still need the human in the loop."
  },
  {
    "speaker": "Harrison",
    "text": "And so deep agents comes with really good human in the loop controls."
  },
  {
    "speaker": "Harrison",
    "text": "And then lastly, delegation."
  },
  {
    "speaker": "Harrison",
    "text": "Agent harnesses can be used to kick off other agents, whether that's planning agents or other sub agents for different tasks."
  },
  {
    "speaker": "Harrison",
    "text": "And so all of that delegation communicating with those subagents and having them communicate back to you, all of that is specified in an agent harness."
  },
  {
    "speaker": "Harrison",
    "text": "And so deep agents contains all of these different things."
  },
  {
    "speaker": "Harrison",
    "text": "We spend a ton of time doing both research and applied AI work to make sure that the way we do summarization is the best, the way that we do subagents is the best."
  },
  {
    "speaker": "Harrison",
    "text": "And so today, one of the things that we're launching is DeepAgeant 0.6, a new version of DeepAgeants."
  },
  {
    "speaker": "Harrison",
    "text": "There's three big things in it that are informed by three trends that we see in the industry."
  },
  {
    "speaker": "Harrison",
    "text": "So one trend we see in the industry is the rise of open models."
  },
  {
    "speaker": "Harrison",
    "text": "DeepSeq V4 launched last week, and it's just as performant on certain tasks as frontier models."
  },
  {
    "speaker": "Harrison",
    "text": "So open source models are getting better."
  },
  {
    "speaker": "Harrison",
    "text": "And the other thing that's happening is cost is rising."
  },
  {
    "speaker": "Harrison",
    "text": "The cost of frontier models keeps on going up and up, and usage keeps on going up and up."
  },
  {
    "speaker": "Harrison",
    "text": "And so one of the things that we think will happen more and more is more usage of open source models."
  },
  {
    "speaker": "Harrison",
    "text": "And so with DeepAgent 0.6, we want to make it the best place to use open source models."
  },
  {
    "speaker": "Harrison",
    "text": "So we're launching native support for GLM5, DeepSeek, and Nemotron models."
  },
  {
    "speaker": "Harrison",
    "text": "We have best-in-class integrations with inference partners like Fireworks, Base10, and NVIDIA."
  },
  {
    "speaker": "Harrison",
    "text": "And the easiest way to try out open source models in a harness is by coding."
  },
  {
    "speaker": "Harrison",
    "text": "And so we're launching deep agents code as an open source example of how to build a coding agent on top of deep agents."
  },
  {
    "speaker": "Harrison",
    "text": "And we're making it really, really good for open source models."
  },
  {
    "speaker": "Harrison",
    "text": "The second thing that we're seeing is a lot of attention around the execution environment."
  },
  {
    "speaker": "Harrison",
    "text": "So we talked about this."
  },
  {
    "speaker": "Harrison",
    "text": "We talked about the virtual file system, which a really simple way to let the agent interact with what it thinks is a file system, but it's just a pretty simple database under the hood."
  },
  {
    "speaker": "Harrison",
    "text": "And then on the other extreme, we have a full-blown code sandbox where the agent can write and execute code, spin up a web server, any of that."
  },
  {
    "speaker": "Harrison",
    "text": "And so this is a spectrum."
  },
  {
    "speaker": "Harrison",
    "text": "But what sits in the middle?"
  },
  {
    "speaker": "Harrison",
    "text": "And so in DeepAgent 0.6, we're launching CodeInterpreter."
  },
  {
    "speaker": "Harrison",
    "text": "What CodeInterpreter is, we use QuickJS, which is a JavaScript runtime."
  },
  {
    "speaker": "Harrison",
    "text": "And it basically lets the agent write and execute code in this kind of like, repel-like environment."
  },
  {
    "speaker": "Harrison",
    "text": "So it's a subset of the JavaScript language, and you can't do everything that you can do in a sandbox."
  },
  {
    "speaker": "Harrison",
    "text": "So you can't run Docker or things like that, but you can still write and call tools programmatically."
  },
  {
    "speaker": "Harrison",
    "text": "You can manipulate data files."
  },
  {
    "speaker": "Harrison",
    "text": "You can read and write from the file system here as well."
  },
  {
    "speaker": "Harrison",
    "text": "And so we think this is a really interesting middle ground where it's super lightweight to deploy."
  },
  {
    "speaker": "Harrison",
    "text": "So this is the benefit of it."
  },
  {
    "speaker": "Harrison",
    "text": "You don't have to spin up a separate sandbox for each agent."
  },
  {
    "speaker": "Harrison",
    "text": "You can just deploy this, and it's really easy to run in a multi-tenant way, but you still get a lot of benefits that you get from coding."
  },
  {
    "speaker": "Harrison",
    "text": "The third trend that we've seen is that it's still really hard, but really important to build delightful UIs."
  },
  {
    "speaker": "Harrison",
    "text": "UIs matter, interacting with the agents matter."
  },
  {
    "speaker": "Harrison",
    "text": "And one thing that's happened is these agents have gotten more and more complicated, and the events that they're emitting are correspondingly more and more complicated."
  },
  {
    "speaker": "Harrison",
    "text": "They emit text, they emit tool calls, images, reasoning, sub-agents, stuff, How do you do that?"
  },
  {
    "speaker": "Harrison",
    "text": "And so we want to make it as easy as possible for people to run agent harnesses and hook them up to delightful UIs that they build for their customers."
  },
  {
    "speaker": "Harrison",
    "text": "And so the third launch in Deep Agents 0.6 is better support for streaming."
  },
  {
    "speaker": "Harrison",
    "text": "So we have a brand new streaming protocol."
  },
  {
    "speaker": "Harrison",
    "text": "We have four different front-end SDKs for different front-end languages."
  },
  {
    "speaker": "Harrison",
    "text": "And we're partnering with UI frameworks, like Co-PilotKit, Assistant UI, and Vercel, to make sure it's really tightly integrated."
  },
  {
    "speaker": "Harrison",
    "text": "UIs are a big part of building agents, and we want to make it the easiest way to do so."
  },
  {
    "speaker": "Harrison",
    "text": "So if you haven't already tried out deep agents, please go try it out today."
  },
  {
    "speaker": "Harrison",
    "text": "This is where we think the future is heading."
  },
  {
    "speaker": "Harrison",
    "text": "We think agent harnesses are getting more and more robust, more and more production ready."
  },
  {
    "speaker": "Harrison",
    "text": "And deep agents is our version of that."
  },
  {
    "speaker": "Harrison",
    "text": "I want to talk about the test phase next."
  },
  {
    "speaker": "Harrison",
    "text": "So you've built your agent."
  },
  {
    "speaker": "Harrison",
    "text": "How do you know if it's actually working?"
  },
  {
    "speaker": "Harrison",
    "text": "This is where Langsmith evaluations comes in, something we've been building over the past two years."
  },
  {
    "speaker": "Harrison",
    "text": "Testing for agents looks different than testing for software."
  },
  {
    "speaker": "Harrison",
    "text": "You want to build up data sets, so reference inputs and reference outputs, or maybe criteria to score how it's doing."
  },
  {
    "speaker": "Harrison",
    "text": "You want to define metrics."
  },
  {
    "speaker": "Harrison",
    "text": "How do you know if the agent is passing?"
  },
  {
    "speaker": "Harrison",
    "text": "This could be correctness."
  },
  {
    "speaker": "Harrison",
    "text": "This could be hallucinations."
  },
  {
    "speaker": "Harrison",
    "text": "But you want to define some metrics that work for your use case."
  },
  {
    "speaker": "Harrison",
    "text": "And then you run your agent over these data sets, and you score them on these metrics, and you create these experiments, and you can use these experiments to hill climb on certain things."
  },
  {
    "speaker": "Harrison",
    "text": "Or you can use them to make sure that you're not regressing as you're making changes."
  },
  {
    "speaker": "Harrison",
    "text": "Evaluations are a key part of Lang Smith, and we're launching some stuff around this today."
  },
  {
    "speaker": "Harrison",
    "text": "But I'm going to talk about that later."
  },
  {
    "speaker": "Harrison",
    "text": "So I'm going to go on to deploy next."
  },
  {
    "speaker": "Harrison",
    "text": "So you've built your agent."
  },
  {
    "speaker": "Harrison",
    "text": "It's running locally."
  },
  {
    "speaker": "Harrison",
    "text": "Now you want to go to production."
  },
  {
    "speaker": "Harrison",
    "text": "There's a bunch of challenges that are going to emerge as you do that."
  },
  {
    "speaker": "Harrison",
    "text": "First, you have to go from a single user, just you."
  },
  {
    "speaker": "Harrison",
    "text": "Now you're serving many in production."
  },
  {
    "speaker": "Harrison",
    "text": "Environment variables and memory, these now have to be specific to the users that you're interacting with."
  },
  {
    "speaker": "Harrison",
    "text": "Off, you need to control who can access it."
  },
  {
    "speaker": "Harrison",
    "text": "You can't just open it up to everyone."
  },
  {
    "speaker": "Harrison",
    "text": "And then when it runs locally and it dies, you're just testing it."
  },
  {
    "speaker": "Harrison",
    "text": "You can resume from there."
  },
  {
    "speaker": "Harrison",
    "text": "But you need to run it durably when you're running it at scale."
  },
  {
    "speaker": "Harrison",
    "text": "And so a year ago, we launched Langsmith deployments to help with this."
  },
  {
    "speaker": "Harrison",
    "text": "So there's a bunch of features built into this."
  },
  {
    "speaker": "Harrison",
    "text": "We launched about 30 different API endpoints to handle streaming, human in the loop, auth, other things like that."
  },
  {
    "speaker": "Harrison",
    "text": "It's a single standard deployment pattern."
  },
  {
    "speaker": "Harrison",
    "text": "Today it's served over 100 million agent runs and is trusted by companies like Workday, Cisco, Etsy, Podium, and ByteDance."
  },
  {
    "speaker": "Harrison",
    "text": "But we also realized that Langsmith deployments isn't the only thing you'll need to bring an agent into production."
  },
  {
    "speaker": "Harrison",
    "text": "We've talked about how agents need an execution environment, And one of the best execution environments is a sandbox."
  },
  {
    "speaker": "Harrison",
    "text": "So whether the agent is a coding agent or not, reading and writing code can be really impactful for the agent."
  },
  {
    "speaker": "Harrison",
    "text": "It can manipulate data that way."
  },
  {
    "speaker": "Harrison",
    "text": "It can use CLIs that way."
  },
  {
    "speaker": "Harrison",
    "text": "And so we generally think that a lot of agents will need the ability to write and execute code in sandboxes."
  },
  {
    "speaker": "Harrison",
    "text": "And so today, we're excited to announce that Lang Smith sandboxes is generally available."
  },
  {
    "speaker": "Harrison",
    "text": "Yeah."
  },
  {
    "speaker": "Harrison",
    "text": "We think this is a big part of Agents in the future, and so we made it really easy to spin up sandboxes in less than a second."
  },
  {
    "speaker": "Harrison",
    "text": "There's persistence for these sandboxes, so that will survive across interactions."
  },
  {
    "speaker": "Harrison",
    "text": "It supports snapshots and forks."
  },
  {
    "speaker": "Harrison",
    "text": "One of the coolest things we've done is this off proxy."
  },
  {
    "speaker": "Harrison",
    "text": "So if you wanna give the LLM the agent, the ability to use something that requires an API key, you don't actually want it to see that API key because then it could get prompt injected and leaked it."
  },
  {
    "speaker": "Harrison",
    "text": "And so we have an off proxy that sits outside the sandbox and basically intercepts traffic and inserts that in."
  },
  {
    "speaker": "Harrison",
    "text": "And this is all part of the Lang Smith SDK, and it's completely framework agnostic."
  },
  {
    "speaker": "Harrison",
    "text": "So you can use it with deep agents, you can use it without deep agents, you can use it for testing agents, you can use it for RL, you can use it for running agents from production."
  },
  {
    "speaker": "Harrison",
    "text": "We're really excited to see how people use it."
  },
  {
    "speaker": "Harrison",
    "text": "We've already had a number of customers using it."
  },
  {
    "speaker": "Harrison",
    "text": "Monday, for example, uses it for their AI assistant sidekick, and we're excited by the feedback that we've gotten so far."
  },
  {
    "speaker": "Harrison",
    "text": "Another big part of bringing agents to production is context."
  },
  {
    "speaker": "Harrison",
    "text": "So LLMs by themselves, they don't know anything, or they don't know everything."
  },
  {
    "speaker": "Harrison",
    "text": "Humans don't know everything."
  },
  {
    "speaker": "Harrison",
    "text": "When we need to look up things, we go to a library."
  },
  {
    "speaker": "Harrison",
    "text": "We look at books to learn things, we read them, and that's exactly what agents do as well."
  },
  {
    "speaker": "Harrison",
    "text": "They do that with context."
  },
  {
    "speaker": "Harrison",
    "text": "And that context has evolved over the years as LLMs have gotten better."
  },
  {
    "speaker": "Harrison",
    "text": "So we had a prompt hub in Lang Smith for the longest time where you could store inversion prompts."
  },
  {
    "speaker": "Harrison",
    "text": "And prompts were the things that kind of like guided agents, but over the past few months and years ago, we've seen that the context provided to agents has graduated from prompts into things like agent.md files, so really detailed instructions, and skills that these agents have used."
  },
  {
    "speaker": "Harrison",
    "text": "A lot of these are shaped by coding agent standards."
  },
  {
    "speaker": "Harrison",
    "text": "Both of these are open standards, by the way, so they're part of open foundations."
  },
  {
    "speaker": "Harrison",
    "text": "And so as the context that LLMs have needed has evolved from prompts into these agent.md and skills, So has our tooling for that."
  },
  {
    "speaker": "Harrison",
    "text": "So today, we're excited to launch Lang Smith Context Hub."
  },
  {
    "speaker": "Harrison",
    "text": "Woo!"
  },
  {
    "speaker": "Harrison",
    "text": "And so, what's in this Context Hub?"
  },
  {
    "speaker": "Harrison",
    "text": "So, you can take your agents.md files, you can take your skills, you can take your like LLM wikis, so this thing that Carpathie did where he basically ran an LLM and had it generate wikis, which are condensed knowledge in markdown files."
  },
  {
    "speaker": "Harrison",
    "text": "We think that's gonna become a more and more common pattern, So you can take all of this, you can store it in Context Hub, you get versioning, you get tags, you get comments, and then you can use these."
  },
  {
    "speaker": "Harrison",
    "text": "You can pull them down locally, you can run them in your coding CLI, you can run them in deep agents as a virtual file system so we have an integration there, or you can use them in whatever agent harness you have."
  },
  {
    "speaker": "Harrison",
    "text": "We think Context Hub is a first start at memory."
  },
  {
    "speaker": "Harrison",
    "text": "We think memory is really, really important to agents in the future."
  },
  {
    "speaker": "Harrison",
    "text": "We think agents.md and skills, you can absolutely view those as an early form of memory."
  },
  {
    "speaker": "Harrison",
    "text": "And those are open standards."
  },
  {
    "speaker": "Harrison",
    "text": "So that's a great thing because we think memory should be open."
  },
  {
    "speaker": "Harrison",
    "text": "We think memory should not be locked in to an LLM, to a framework, or to a platform."
  },
  {
    "speaker": "Harrison",
    "text": "And so even though we're building Context Hub, we want this idea of context to be really open."
  },
  {
    "speaker": "Harrison",
    "text": "And so we're working with a number of companies, including Redis, Elastic, Mongo, and Pinecone, to turn this first stab at memory into something that's an open standard for memory, for agents."
  },
  {
    "speaker": "Harrison",
    "text": "So we think everything should be open."
  },
  {
    "speaker": "Harrison",
    "text": "And lastly, we've got monitor."
  },
  {
    "speaker": "Harrison",
    "text": "So you've launched it."
  },
  {
    "speaker": "Harrison",
    "text": "But how do you know what the agent's actually doing?"
  },
  {
    "speaker": "Harrison",
    "text": "This is where a lot of the core links with functionality around tracing."
  },
  {
    "speaker": "Harrison",
    "text": "So you can make sure that you can see the step of every agent and what the inputs are and what the outputs are."
  },
  {
    "speaker": "Harrison",
    "text": "Dashboards, so you can track cost and latency over time."
  },
  {
    "speaker": "Harrison",
    "text": "online evals, so you can run LLM as a judge or code over these traces, get some feedback and then attach that or just capture user feedback."
  },
  {
    "speaker": "Harrison",
    "text": "All of this is part of Ling Smith Observability."
  },
  {
    "speaker": "Harrison",
    "text": "We've been building a lot here over the past two years and over the past few months."
  },
  {
    "speaker": "Harrison",
    "text": "We've got a few very big launches here, but we're going to save that for a little bit later."
  },
  {
    "speaker": "Harrison",
    "text": "So this is the agent development life cycle, and this is what it makes -- this is what it looks like to bring agents and maintain agents in production."
  },
  {
    "speaker": "Harrison",
    "text": "And when you You do it once for an agent that's fine."
  },
  {
    "speaker": "Harrison",
    "text": "When you do it for 10 or when you do it for 100 agents, that's when you really need to start to think about the governance of all of this."
  },
  {
    "speaker": "Harrison",
    "text": "How do you do this at scale?"
  },
  {
    "speaker": "Harrison",
    "text": "How do you do this in a cost efficient and secure way?"
  },
  {
    "speaker": "Harrison",
    "text": "And so specifically, two of the concerns that we've seen emerge around governance over the past few months have been cost and data exposure."
  },
  {
    "speaker": "Harrison",
    "text": "LLMs are getting expensive."
  },
  {
    "speaker": "Harrison",
    "text": "How do you know how much agents are spending, how much specific users are spending on agents, and how do you avoid surprise bills?"
  },
  {
    "speaker": "Harrison",
    "text": "On the data exposure side, LLMs are great at working with data, but they shouldn't be able to access every source of data."
  },
  {
    "speaker": "Harrison",
    "text": "And so how do you control what they can and can't see?"
  },
  {
    "speaker": "Harrison",
    "text": "Today, we're launching Langsmith LLM Gateway in beta to help with that."
  },
  {
    "speaker": "Harrison",
    "text": "Woo!"
  },
  {
    "speaker": "Harrison",
    "text": "You guys can't just pick and choose which announcements you clap for."
  },
  {
    "speaker": "Harrison",
    "text": "You've got to applaud for all of them."
  },
  {
    "speaker": "Harrison",
    "text": "They're all great."
  },
  {
    "speaker": "Harrison",
    "text": "So what is Link Smith LLM Gateway?"
  },
  {
    "speaker": "Harrison",
    "text": "So you've got your agents, they're running."
  },
  {
    "speaker": "Harrison",
    "text": "Link Smith LLM Gateway basically sits between them and their LLM calls."
  },
  {
    "speaker": "Harrison",
    "text": "You can set spend limits."
  },
  {
    "speaker": "Harrison",
    "text": "You can have visibility, total visibility over spend."
  },
  {
    "speaker": "Harrison",
    "text": "And then you can also set guardrails to help with PII and secret detection."
  },
  {
    "speaker": "Harrison",
    "text": "It integrates with a bunch of coding agents out there."
  },
  {
    "speaker": "Harrison",
    "text": "So you can use it."
  },
  {
    "speaker": "Harrison",
    "text": "We know that coding agents is the most popular thing that people are using."
  },
  {
    "speaker": "Harrison",
    "text": "And that's where a lot of these costs are happening."
  },
  {
    "speaker": "Harrison",
    "text": "And so we've made sure to integrate it with a lot of coding agents out there."
  },
  {
    "speaker": "Harrison",
    "text": "It integrates with all the LLM providers that LangChain can help you access, and everything's traced automatically to LangSmith."
  },
  {
    "speaker": "Harrison",
    "text": "So this is the full agent development lifecycle."
  },
  {
    "speaker": "Harrison",
    "text": "Everything that we're building kind of fits into this."
  },
  {
    "speaker": "Harrison",
    "text": "And we recognize that there's a lot in here."
  },
  {
    "speaker": "Harrison",
    "text": "Taking an agent and going to production and going through this lifecycle involves a bunch of different pieces."
  },
  {
    "speaker": "Harrison",
    "text": "And so we want to make it as easy as possible for people to take all these pieces, take deep agents, which is our agent harness under the hood, and really, really easily go to production."
  },
  {
    "speaker": "Harrison",
    "text": "And so to make that into a single API, today we're announcing in private preview, Manage Deep Agents."
  },
  {
    "speaker": "Harrison",
    "text": "Woo!"
  },
  {
    "speaker": "Harrison",
    "text": "So Manage Deep Agents is a single API for interacting with all these different components."
  },
  {
    "speaker": "Harrison",
    "text": "So it runs the deep agent harness under the hood."
  },
  {
    "speaker": "Harrison",
    "text": "It's deployed with Lang Smith deployments."
  },
  {
    "speaker": "Harrison",
    "text": "And so that's where the agent will run."
  },
  {
    "speaker": "Harrison",
    "text": "The models that you can access include any models out there."
  },
  {
    "speaker": "Harrison",
    "text": "So we obviously integrate with OpenAI and Anthropic, but also with the open source model providers like Fireworks and Base10."
  },
  {
    "speaker": "Harrison",
    "text": "All of the agent instructions and memory are stored in Context Hub, so that as you or your users or the agent itself updates them, you can see them there and version them there and track them there."
  },
  {
    "speaker": "Harrison",
    "text": "These agents, when they're deployed, you basically want to deploy the agent over here and then give it access to a sandbox to run and write tools over here."
  },
  {
    "speaker": "Harrison",
    "text": "And you want those to be separate."
  },
  {
    "speaker": "Harrison",
    "text": "And so that's the architecture that we took."
  },
  {
    "speaker": "Harrison",
    "text": "And we used Langsmith sandboxes to help power those sandboxes in the hood."
  },
  {
    "speaker": "Harrison",
    "text": "MCPs are how you connect them to tools."
  },
  {
    "speaker": "Harrison",
    "text": "So you can provide MCPs directly, or you can use Arcade or another partner that provides access to a lot of MCP servers to do that."
  },
  {
    "speaker": "Harrison",
    "text": "And all of this streams out in the new streaming protocol that we announced."
  },
  {
    "speaker": "Harrison",
    "text": "So you can integrate it super seamlessly with Co-Pilot Kit, Assistant UI, and other frameworks."
  },
  {
    "speaker": "Harrison",
    "text": "So combining everything, LangChain Open Source and LangSmith power this whole agent development lifecycle."
  },
  {
    "speaker": "Harrison",
    "text": "And we think that traces sit at the center of this lifecycle."
  },
  {
    "speaker": "Harrison",
    "text": "And so we spend a lot of time as a company thinking about traces and thinking about how to build the best experience around them."
  },
  {
    "speaker": "Harrison",
    "text": "Everyone does."
  },
  {
    "speaker": "Harrison",
    "text": "But there's no one at the company who thinks more about traces than my co-founder, Ankush."
  },
  {
    "speaker": "Harrison",
    "text": "He's been thinking for the past almost a year around how we can make the experience around traces the best possible experience, because this is what powers that whole loop."
  },
  {
    "speaker": "Harrison",
    "text": "And so we're launching a lot of really cool things around this, but in order to talk about traces and his love of traces, I'd like to welcome onto the stage my co-founder, Ankesh Gola."
  },
  {
    "speaker": "Ankush",
    "text": "Hey, everyone."
  },
  {
    "speaker": "Ankush",
    "text": "I'm Ankush, co-founder and CTO here at LangChain."
  },
  {
    "speaker": "Ankush",
    "text": "As Harrison mentioned, I do spend a lot of time thinking about agent traces."
  },
  {
    "speaker": "Ankush",
    "text": "And that's because we really think that agent traces are at the center of the agent development lifecycle."
  },
  {
    "speaker": "Ankush",
    "text": "Each agent trace captures the unique behavioral record of what your agent actually did at a specific point in time."
  },
  {
    "speaker": "Ankush",
    "text": "That being said, agent traces, or more generally, agent observability, poses a unique data infrastructure problem."
  },
  {
    "speaker": "Ankush",
    "text": "For one, agent traces are very deeply nested and can contain thousands, if not tens of thousands, of intermediate steps."
  },
  {
    "speaker": "Ankush",
    "text": "The payloads associated with agent traces are large and unbounded."
  },
  {
    "speaker": "Ankush",
    "text": "These two characteristics of agent traces are a direct result of agents running for longer time horizons and LLM context window sizes getting larger and larger."
  },
  {
    "speaker": "Ankush",
    "text": "We're seeing an increased number of agent traces being logged with modalities, such as images and voice."
  },
  {
    "speaker": "Ankush",
    "text": "Voice is getting especially popular with applications like customer support."
  },
  {
    "speaker": "Ankush",
    "text": "Finally, the access patterns or the query patterns needed to effectively mine your agent traces for useful insights are unique and complex."
  },
  {
    "speaker": "Ankush",
    "text": "Agent traces are not only encoding more information and getting more complicated, they're also growing in volume as agents become more and more ubiquitous."
  },
  {
    "speaker": "Ankush",
    "text": "Here's a figure that highlights a real Langsmith customer's weekly trace volume over time."
  },
  {
    "speaker": "Ankush",
    "text": "As you can see, in the early stages of testing and development, the weekly trace volumes are relatively small."
  },
  {
    "speaker": "Ankush",
    "text": "But as the agent enters production And as new agents enter the picture, the weekly trace volume that we now see is over 150 million."
  },
  {
    "speaker": "Ankush",
    "text": "So as mentioned earlier, the payloads associated with agent traces are large, and they're getting bigger over time."
  },
  {
    "speaker": "Ankush",
    "text": "Over the past couple of years, we've seen the P50 payload size associated with agent traces sent to Langsmith grow from 6 kilobytes to 37 kilobytes."
  },
  {
    "speaker": "Ankush",
    "text": "And P99 has grown from still a pretty sizable 364 kilobytes to 12 megabytes today."
  },
  {
    "speaker": "Ankush",
    "text": "And another data point."
  },
  {
    "speaker": "Ankush",
    "text": "Earlier this year, we had a single customer send us 50 terabytes of trace data on a single day."
  },
  {
    "speaker": "Ankush",
    "text": "That's quite a lot of data."
  },
  {
    "speaker": "Ankush",
    "text": "This video highlights what a modern agent trace in Langsmith looks like in practice."
  },
  {
    "speaker": "Ankush",
    "text": "As you can see, lots of intermediate steps, very deeply nested."
  },
  {
    "speaker": "Ankush",
    "text": "This trace is actually pulled from one of our internal go-to-market agents that's built with deep agents."
  },
  {
    "speaker": "Ankush",
    "text": "And another thing to point out is that this trace actually encodes 8.1 million tokens."
  },
  {
    "speaker": "Ankush",
    "text": "Traditional data infrastructure was not built for the challenges associated with agent observability."
  },
  {
    "speaker": "Ankush",
    "text": "If you're using suboptimal infrastructure to handle agent observability workloads, you will experience slow queries and ingestion bottlenecks."
  },
  {
    "speaker": "Ankush",
    "text": "You'll also experience rising infrastructure costs and complexity as you try to scale up."
  },
  {
    "speaker": "Ankush",
    "text": "When you're iterating on your agent, you cannot afford to have slow and cumbersome interactions with your agent traces."
  },
  {
    "speaker": "Ankush",
    "text": "And so today, we're super excited to be launching SmithDB."
  },
  {
    "speaker": "Ankush",
    "text": "SmithDB is the database we purpose built for agent observability workloads."
  },
  {
    "speaker": "Ankush",
    "text": "We've been working on SmithDB for the past few months and are incredibly excited by the results that we're seeing in production."
  },
  {
    "speaker": "Ankush",
    "text": "Please stay tuned for this video to learn a little bit more."
  },
  {
    "speaker": "Narrator",
    "text": "Introducing SmithDB, the database purpose built for agent observability."
  },
  {
    "speaker": "Narrator",
    "text": "This is a trace, a record of what your agent does, how it thinks, decides, and performs."
  },
  {
    "speaker": "Narrator",
    "text": "Now, imagine thousands of them, millions growing each day, because agents are everywhere."
  },
  {
    "speaker": "Narrator",
    "text": "The problem is that traces aren't like traditional logs and metrics."
  },
  {
    "speaker": "Narrator",
    "text": "They're larger, deeply nested, multimodal, and you don't query them the same way."
  },
  {
    "speaker": "Narrator",
    "text": "You're searching across text and meaning, In traditional databases, they weren't built for this."
  },
  {
    "speaker": "Narrator",
    "text": "So as traces grow, searches slow until now."
  },
  {
    "speaker": "Narrator",
    "text": "SmithDB, the database purpose built for agent observability."
  },
  {
    "speaker": "Narrator",
    "text": "Search across Vultrace content, query entire agent conversations, access conflicts data instantly and at scale."
  },
  {
    "speaker": "Narrator",
    "text": "Building reliable agents requires rapid iteration."
  },
  {
    "speaker": "Narrator",
    "text": "With SmithDB, you can move from data to insight, to improvement faster."
  },
  {
    "speaker": "Ankush",
    "text": "That video got me pretty hyped up, not gonna lie."
  },
  {
    "speaker": "Ankush",
    "text": "Whoever's creating our videos is doing an amazing job."
  },
  {
    "speaker": "Ankush",
    "text": "So now let's take a closer look at what SmithDB actually is and how it's architected."
  },
  {
    "speaker": "Ankush",
    "text": "The first thing to point out is that SmithDB is backed by object storage."
  },
  {
    "speaker": "Ankush",
    "text": "This gives us a few nice properties."
  },
  {
    "speaker": "Ankush",
    "text": "First, object storage is incredibly cheap, and it scales pretty much infinitely."
  },
  {
    "speaker": "Ankush",
    "text": "The second is it gives us what's called compute storage separation."
  },
  {
    "speaker": "Ankush",
    "text": "This allows us to elastically scale the services that Baxmyth DB without any complex shuffling or sharding of data as you scale up the services."
  },
  {
    "speaker": "Ankush",
    "text": "Third, this gives us an architecture that is relatively easy to set up in self-hosted environments where dated residency requirements are strict."
  },
  {
    "speaker": "Ankush",
    "text": "Now at a high level, the Langsmith services connect to SmithDB after getting assignments from our cluster manager."
  },
  {
    "speaker": "Ankush",
    "text": "Our cluster manager helps ensure that load is evenly distributed across our servers and it also maintains some semblance of what's called sticky routing."
  },
  {
    "speaker": "Ankush",
    "text": "Sticky routing is important because it helps utilize cache, and it also helps batch our data effectively for ingestion."
  },
  {
    "speaker": "Ankush",
    "text": "So during ingestion, raw trace data comes into our ingestion service."
  },
  {
    "speaker": "Ankush",
    "text": "It gets batched, and it gets durably stored to object storage."
  },
  {
    "speaker": "Ankush",
    "text": "These files are registered in a Postgres backed meta store."
  },
  {
    "speaker": "Ankush",
    "text": "At query time, we figure out which files are necessary to be scanned for the queries."
  },
  {
    "speaker": "Ankush",
    "text": "We download them from object storage, and we scan them."
  },
  {
    "speaker": "Ankush",
    "text": "We also heavily utilize SSD caching and memory to minimize round trips to object storage."
  },
  {
    "speaker": "Ankush",
    "text": "Finally, we have a compaction service that helps shape our files for more optimal querying."
  },
  {
    "speaker": "Ankush",
    "text": "SmithDB is specifically designed for agent observability access patterns."
  },
  {
    "speaker": "Ankush",
    "text": "We'll walk through some of these access patterns in the next few slides."
  },
  {
    "speaker": "Ankush",
    "text": "SmithDB makes clicking into individual traces and individual intermediate steps really snappy and fast."
  },
  {
    "speaker": "Ankush",
    "text": "Agent observability isn't just about asking what happened across millions of traces."
  },
  {
    "speaker": "Ankush",
    "text": "It's also about asking what happened in this one particular agent execution."
  },
  {
    "speaker": "Ankush",
    "text": "That's why random access is really important and something that we've optimized in SmithDB."
  },
  {
    "speaker": "Ankush",
    "text": "Agent traces can contain megabytes of text data."
  },
  {
    "speaker": "Ankush",
    "text": "And oftentimes, you need to search across your agent traces using keywords or phrases."
  },
  {
    "speaker": "Ankush",
    "text": "As you can see, SmithDB makes full text search really snappy and interactive."
  },
  {
    "speaker": "Ankush",
    "text": "To accomplish this, we've actually built a custom inverted index layout specifically designed for object storage."
  },
  {
    "speaker": "Ankush",
    "text": "and you can You often need to pick a specific time horizon and apply filters like on metadata, tags, name, latency, and other attributes."
  },
  {
    "speaker": "Ankush",
    "text": "Scanning and filtering speed is something that we've highly optimized within SmithDB."
  },
  {
    "speaker": "Ankush",
    "text": "And as you can see, the results are nearly instant."
  },
  {
    "speaker": "Ankush",
    "text": "We're incredibly pleased by the performance that SmithDB brings to Langsmith across these key agent and observability workloads."
  },
  {
    "speaker": "Ankush",
    "text": "Compared to before SmithDB, these Lang Smith workloads are now anywhere from 6x to 15x faster than before."
  },
  {
    "speaker": "Ankush",
    "text": "This is absolutely massive."
  },
  {
    "speaker": "Ankush",
    "text": "But look, don t just take our word for it."
  },
  {
    "speaker": "Ankush",
    "text": "We re super lucky to be working with customers like Clay and Vanta, who were early adopters for SmithDB."
  },
  {
    "speaker": "Ankush",
    "text": "to be on Langsmith."
  },
  {
    "speaker": "Ankush",
    "text": "As you can see Jeff from clay and Andy from Banta both state how SmithDB has completely transform their experience with their traces within Langsmith."
  },
  {
    "speaker": "Ankush",
    "text": "So SmithDB is purpose-built for agent observability and we built it using a modern tech stack."
  },
  {
    "speaker": "Ankush",
    "text": "The entire system is written in Rust and we use two awesome open source projects."
  },
  {
    "speaker": "Ankush",
    "text": "one is called a PEP."
  },
  {
    "speaker": "Ankush",
    "text": "patchy data fusion, which is an extensible, rust-based query engine."
  },
  {
    "speaker": "Ankush",
    "text": "The second is Vortex, which is an extensible file format that allows us to pick custom encodings and custom chunking strategies for the different columns that we store."
  },
  {
    "speaker": "Ankush",
    "text": "On top of this foundation, we have heavily-- we've added some heavy customizations around indexing, specifically for full-text search."
  },
  {
    "speaker": "Ankush",
    "text": "We've added custom query planning and execution plans."
  },
  {
    "speaker": "Ankush",
    "text": "And we also have invested in custom storage layouts for all the data that we're storing within SmithDB."
  },
  {
    "speaker": "Ankush",
    "text": "Here are some of the technical challenges that we've had to solve when building SmithDB."
  },
  {
    "speaker": "Ankush",
    "text": "These are just a few of them."
  },
  {
    "speaker": "Ankush",
    "text": "They're quite a lot, but I try to choose."
  },
  {
    "speaker": "Ankush",
    "text": "So in agent observability workloads, your spans are distributed."
  },
  {
    "speaker": "Ankush",
    "text": "They come in different parts."
  },
  {
    "speaker": "Ankush",
    "text": "And this is because agents run for long time horizons."
  },
  {
    "speaker": "Ankush",
    "text": "And so you can have a start event that gets sent sometimes hours before your end event."
  },
  {
    "speaker": "Ankush",
    "text": "And so finding and merging these distributed events together at query time and at compaction time is a technical challenge that we had to solve."
  },
  {
    "speaker": "Ankush",
    "text": "Doing it efficiently is something that we've invested a lot of time in."
  },
  {
    "speaker": "Ankush",
    "text": "A lot of the queries within Lang Smith are top case style queries."
  },
  {
    "speaker": "Ankush",
    "text": "So they contain an order by and limit."
  },
  {
    "speaker": "Ankush",
    "text": "And a more naive query plan would essentially like find all the files that are in range and fan them out, scan them, do some type of merge and top K operation."
  },
  {
    "speaker": "Ankush",
    "text": "This is actually like a little bit expensive on object storage, actually quite expensive on object storage."
  },
  {
    "speaker": "Ankush",
    "text": "So what we've done is we've taken a time window based approach and encoded that into a custom execution plan that feeds top case to alqueries within SmithDB."
  },
  {
    "speaker": "Ankush",
    "text": "Finally, in observability workloads, you often need to serve the most recently ingested data as fast as possible."
  },
  {
    "speaker": "Ankush",
    "text": "And in order to do that, what we do is we buffer data in the ingestion service even after it's been durably flushed to object storage."
  },
  {
    "speaker": "Ankush",
    "text": "and we buffer it in memory and on SSD."
  },
  {
    "speaker": "Ankush",
    "text": "And we make that data available to the query service to avoid downloading a ton of small files for leading edge style queries."
  },
  {
    "speaker": "Ankush",
    "text": "Langsmith performance is not only important for human UX, but also agent UX."
  },
  {
    "speaker": "Ankush",
    "text": "Increasingly, agents are not just the thing that are being observed by Langsmith, they are also the users of Langsmith."
  },
  {
    "speaker": "Ankush",
    "text": "And it's a huge hit to have your agents slow down by inefficient tools."
  },
  {
    "speaker": "Ankush",
    "text": "I really like this quote from Jeff Dean, who states that, you know, as we get agent-based systems that are operating multiple times faster than a human, your tools can become like an Amdell's Blah Blah bottleneck."
  },
  {
    "speaker": "Ankush",
    "text": "We're super excited to announce that SmithDB is now serving core observability workloads across all of US Cloud on Langsmith."
  },
  {
    "speaker": "Ankush",
    "text": "So if you're using Langsmith on smith.langchain.com, all of your interactions and your tracing projects page are now powered by SmithDB."
  },
  {
    "speaker": "Ankush",
    "text": "Soon-- we're working quickly to get the rest of the Langsmith UI back by SmithDB."
  },
  {
    "speaker": "Ankush",
    "text": "And we're going to bring it soon to self-hosted and across all of global cloud traffic."
  },
  {
    "speaker": "Ankush",
    "text": "So SmithDB sets a really, really strong technical foundation for everything that we want to build into Langsmith."
  },
  {
    "speaker": "Ankush",
    "text": "And to share some more exciting updates about Langsmith, I'd like to welcome Harrison back on stage."
  },
  {
    "speaker": "Ankush",
    "text": "Thank you so much."
  },
  {
    "speaker": "Harrison",
    "text": "SmithDB is absolutely incredible."
  },
  {
    "speaker": "Harrison",
    "text": "As you can see, I have the fun and easy job of just talking about what we build, but on Cush and the whole team there goes out and builds really complex engineering projects and databases that help power everything in the agent development life cycle."
  },
  {
    "speaker": "Harrison",
    "text": "And that's really how we think about what we do."
  },
  {
    "speaker": "Harrison",
    "text": "We want to accelerate everything in this life cycle."
  },
  {
    "speaker": "Harrison",
    "text": "We think traces and SmithDB are a key part of that."
  },
  {
    "speaker": "Harrison",
    "text": "And so with this solid foundation, a big part of what we're thinking about now is how can we accelerate this life cycle even more?"
  },
  {
    "speaker": "Harrison",
    "text": "Because even with traces and even with observability, the visibility that it provides is table stakes."
  },
  {
    "speaker": "Harrison",
    "text": "Being able to see what your agent did at each step is absolutely needed, but that is table stakes."
  },
  {
    "speaker": "Harrison",
    "text": "It's still hard to spin this iteration flywheel."
  },
  {
    "speaker": "Harrison",
    "text": "Finding issues among the tens of thousands, hundreds of thousands, millions of traces that you have is still hard."
  },
  {
    "speaker": "Harrison",
    "text": "Once you find those traces, understanding issues in them is still hard."
  },
  {
    "speaker": "Harrison",
    "text": "They can be really, really long."
  },
  {
    "speaker": "Harrison",
    "text": "You have to comb through them and see exactly where the LLM is messing up, where it's calling the wrong tool."
  },
  {
    "speaker": "Harrison",
    "text": "Once you understand that issue, Fixing them is hard."
  },
  {
    "speaker": "Harrison",
    "text": "Do you want to change the prompt?"
  },
  {
    "speaker": "Harrison",
    "text": "Do you want to change the code?"
  },
  {
    "speaker": "Harrison",
    "text": "Do you want to change some tools?"
  },
  {
    "speaker": "Harrison",
    "text": "There's a bunch of different things that you have to investigate and try to tie back to the core issue."
  },
  {
    "speaker": "Harrison",
    "text": "And then once you fix it, avoiding repeating these issues is hard."
  },
  {
    "speaker": "Harrison",
    "text": "Sometimes it can feel like whack-a-mole."
  },
  {
    "speaker": "Harrison",
    "text": "You fix one thing, and then you change the prompt, and it reappears."
  },
  {
    "speaker": "Harrison",
    "text": "And so how do you avoid this?"
  },
  {
    "speaker": "Harrison",
    "text": "And so we spend a lot of time thinking about how we can spin up this flywheel faster and faster because it is still hard."
  },
  {
    "speaker": "Harrison",
    "text": "All these things I mentioned are still annoying."
  },
  {
    "speaker": "Harrison",
    "text": "And so what do you do when you have a lot of really annoying things that are hard and important that you don't want to do?"
  },
  {
    "speaker": "Harrison",
    "text": "You build an agent to help you with them, of course."
  },
  {
    "speaker": "Harrison",
    "text": "And so that's why today we're really excited to launch an agent in Langsmith, an ambient, proactive, action-taking agent that we're calling Langsmith Engine."
  },
  {
    "speaker": "Harrison",
    "text": "Specifically, what it does is it will sit on top of your traces."
  },
  {
    "speaker": "Harrison",
    "text": "It'll go through them on a schedule in the background."
  },
  {
    "speaker": "Harrison",
    "text": "It will detect issues and assign a priority to them."
  },
  {
    "speaker": "Harrison",
    "text": "It will back its evidence with traces."
  },
  {
    "speaker": "Harrison",
    "text": "And then it will suggest concrete resolution actions."
  },
  {
    "speaker": "Harrison",
    "text": "We've been working with a number of startups over the past few weeks to roll this out to them."
  },
  {
    "speaker": "Harrison",
    "text": "And as you can see, it is already proactively suggesting evals to add and code changes to make and has dramatically reduced time to detection and time to triage."
  },
  {
    "speaker": "Harrison",
    "text": "So specifically what Engine can do, it acts at all stages of this life cycle."
  },
  {
    "speaker": "Harrison",
    "text": "So it sits on top of traces."
  },
  {
    "speaker": "Harrison",
    "text": "It can suggest code changes if you hook it up to your GitHub or code base."
  },
  {
    "speaker": "Harrison",
    "text": "It can suggest data points to add to data sets so that you can use these to avoid regressions in the future."
  },
  {
    "speaker": "Harrison",
    "text": "If you connect it to Prompt or Context Hub, it can suggest changes there."
  },
  {
    "speaker": "Harrison",
    "text": "And then it can also suggest online evals to add so that you can track these issues over time."
  },
  {
    "speaker": "Harrison",
    "text": "Let's see a little video of it in action."
  },
  {
    "speaker": "Harrison",
    "text": "LayingSmith Engine is in public beta as of today."
  },
  {
    "speaker": "Harrison",
    "text": "So I already see some people on laptops log on to LayingSmith and try it out."
  },
  {
    "speaker": "Harrison",
    "text": "Overall, as a company, we're building the entire platform for the agent development lifecycle."
  },
  {
    "speaker": "Harrison",
    "text": "Over the past few years, we've been building a lot of the different apps and infrastructure pieces from observability and evaluations and Prompt Hub that help power a lot of this lifecycle."
  },
  {
    "speaker": "Harrison",
    "text": "Today, we launched SmithDB as a foundational database to power all of this."
  },
  {
    "speaker": "Harrison",
    "text": "And we built LangSmith Engine as an agent that sits on top and helps you spin this flywheel faster and faster."
  },
  {
    "speaker": "Harrison",
    "text": "more than just a platform, we also want to be a partner to everyone in this room, in the community, in the entire space in general."
  },
  {
    "speaker": "Harrison",
    "text": "And that's why we're really thrilled about Interrupt in General."
  },
  {
    "speaker": "Harrison",
    "text": "This is an opportunity to interrupt your day and take a pause and learn from us, but also other presenters and other partners in the ecosystem and other companies and other people that you're sitting next to, and I would encourage everyone to take full advantage of not only today but also tomorrow as well."
  }
]