Launch HN:Laminar(YC S24)——通过强化学习训练、用于发现智能体轨迹错误的模型
Launch HN: Laminar (YC S24) – RL-trained model that finds errors in agent traces
我们发现了什么
自 2024 年以来,我们一直在构建面向 AI 智能体的开源可观测性工具。要发现这些错误,你需要了解智能体试图做什么,并检查其 LLM 调用和工具结果。
- 来源:Hacker News(发现于 2026-10-20)
- 证据等级:D · 发现产品或需求信号,暂未获得可核验的商业证据。
- 商业模式:待核验
- 主题:AI Agent
- 初筛评分:25/100 · 收录 1 次
证据,比故事更重要。
规则清洗与初筛,未经人工商业核验。原文语境、实际客户和付费情况仍需自行验证。
引用与数字披露
来源类型(原作者自述/第三方测算/媒体转引)需采集端标注,本版尚未落字段。
- 作者
- 未标注
- 抓取日期
- 来源类型
- 未标注
- 币种
- 未标注
- 口径
- 未标注
- 披露主体
- 未标注
- 披露日期
- 未标注
中文辅助译文(全文)
HN 大家好,我们是 Laminar(https://laminar.sh)的 Robert 和 Din。自 2024 年以来,我们一直在构建面向 AI 智能体的开源可观测性工具Recently,我们发布了 flow-1,这是一个通过 RL 训练、可在智能体执行轨迹中查找错误的模型。在我们的基准测试(https://laminar.sh/blog/flow-1)中,它的检测质量与 GPT-6-sol 相当,但成本低 23 倍。这让分析每一条生产环境智能体轨迹都变得经济可行,无需进行采样。下面是一段一分钟的演示:https://youtu.be/KJa3h6ZJNLQ 我们还撰写了一篇文章,介绍 flow-1 和其他模型对示例轨迹的分析:https://laminar.sh/blog/flow-1-in-action 智能体可观测性领域竞争激烈,因此与其用项目符号罗列 Laminar 与 X 的不同之处,不如从第一性原理出发,解释我们如何解决智能体可观测性问题。如今,智能体会运行许多步骤,并以隐式方式发生故障。智能体可能点击错误的按钮或引用错误的文档,而每次调用都成功完成。这些错误最值得捕获和理解。要找到它们,你需要理解智能体试图做什么,并检查其 LLM 调用和工具结果。仅查看智能体的最终输出并不够。仅仅收集轨迹也无法解决这个问题。许多智能体可观测性平台的核心仍然只是数据收集器。你可能最终需要付费存储大量无人有时间阅读或从中提取价值的轨迹。使用另一个 LLM 检查轨迹就是终极解决方案,但高能力模型在大规模运行下成本高昂,而较便宜的模型往往会漏掉错误或标记无关的问题。
因此,我们构建了我们的模型来专门解决这个问题。我们微调了一个小型开源模型,随后使用 RL 对数千个涉及软件、法律、客服等真实智能体工作流的合成调查进行后训练。我们由此获得了一个既擅长分析智能体轨迹、运行成本又非常低的模型。flow-1 运行在我们称为 Signals 的框架内。它充当一个编程智能体,将智能体轨迹视为代码仓库,把每个 span(一次 LLM 调用、工具调用等)视为一个文件。它从完整智能体轨迹的压缩字符串表示和一条用户提示开始,随后跨各个 span 进行 grep,并完整读取相关内容。Signals 的妙处在于它能够响应通用提示。你可以要求它识别用户挫败情绪、检查浏览器智能体是否完成结账等。它并不局限于原始错误检测。它以 JSON 格式返回发现结果,其 schema 可由用户自由定义。我们称这些结果为信号事件。一旦分析了每一条轨迹,你还会遇到过多单个事件需要阅读。因此,我们会自动将相似的信号事件分组为集群。你可以看到反复出现的问题及其发生频率,然后深入查看单个事件及其背后的轨迹。你可以使用某个集群中的轨迹,为该类故障构建一个评估数据集。随后,可以使用你最喜欢的编程智能体在这些评估上进行爬山优化,并在将修复发布到生产环境之前,检查该修复是否能在这些案例中奏效。轨迹 → 分析 → 捕获错误并形成集群 → 修复 → 发布。打造易于使用的这一闭环,正是我们构建 Laminar 的原因。我们也以同样的理念打造 Laminar 的其余部分。
我们的博客(https://laminar.sh/blog)详细介绍了,仔细观察智能体的实际工作方式如何促使我们构建 20 倍轨迹压缩、自定义 SQL 查询引擎和自动任务提取功能。Laminar 采用 Apache 2.0 许可证,并支持自托管(https://github.com/lmnr-ai/lmnr)。我们通过托管云服务盈利。我们很想了解你目前如何跟踪智能体的表现。你从用户反馈中了解到的信息与自己监控所得的信息相比各占多少?当你修复某个问题时,你如何检查它没有引入另一种故障?
译文由上游机器翻译生成,可能有误;判断请以英文原文为准。
英文原文(来源本站未改写)
Hi HN, we’re Robert and Din from Laminar ( https://laminar.sh ).We’ve been building open-source observability for AI agents since 2024.Recently, we released flow-1, a model trained with RL to find errors in agent traces.On our benchmark ( https://laminar.sh/blog/flow-1 ), it matches GPT-6-sol in detection quality while being 23x cheaper.This makes it affordable to analyze every production agent trace, without sampling.
Here’s a one-minute walkthrough: https://youtu.be/KJa3h6ZJNLQ We also put together a post with example traces and analyses from flow-1 and other models: https://laminar.sh/blog/flow-1-in-action Agent observability is crowded, so instead of a bullet list of how Laminar differs from X, we’ll explain how we’re solving agent observability from first principles.Agents now run for many steps and fail implicitly.An agent can click the wrong button or cite the wrong document while every call completes successfully.These errors are the most useful ones to catch and understand.To find them, you need to understand what the agent was trying to do and inspect its LLM calls and tool results.
Simply looking at the final agent output is not enough.Collecting traces alone doesn’t solve this.A lot of agent observability platforms are still data collectors at their core.You can end up paying to store traces that nobody has time to read or extract value from.Using another LLM to inspect traces is THE solution, but capable models are expensive at scale and cheaper ones often miss errors or flag unrelated things.So we built our model to solve exactly this problem.We finetuned a small OSS model and then post trained it with RL on thousands of synthetic investigations of realistic agent workflows in software, legal, customer support, etc.
We got a model that is both good at agent trace analysis and very cheap to run. flow-1 runs inside a harness we call Signals.It acts as a coding agent, treating an agent trace like a repo, with each span (an LLM call, tool call, etc.) as a file.It starts from a compressed string representation of a full agent trace and a user prompt, then greps across spans and reads the relevant ones in full.The beauty of Signals is that it can respond to a general prompt.You can ask it to identify user frustration, check whether your browser agent completed a checkout, and so on.It’s not limited to raw error detection.It returns findings as JSON in a schema users can freely define.
We call these signal events.Once you’re analyzing every trace, you also have too many individual events to read.That’s why we automatically group similar signal events into clusters.You can see recurring problems and how often they happen, then drill into individual events and the traces behind them.You can use traces from a cluster to build an eval dataset for that type of failure.You can then use your favourite coding agent to hillclimb on those evals and check that the fix works across these cases before shipping it to prod.Trace → analyze → catch errors and form clusters → fix → release.Making this loop easy is why we built Laminar.We’ve put the same thought into the rest of Laminar.
Our blog ( https://laminar.sh/blog ) explains how looking closely at how agents actually work led us to build 20x trace compression, a custom SQL query engine and automatic task extraction.Laminar is Apache 2.0 and self-hostable ( https://github.com/lmnr-ai/lmnr ).We make money from the managed cloud.We’d love to hear how you track your agents’ performance today.How much do you learn from user feedback versus your own monitoring?And when you fix something, how do you check that it hasn’t introduced a different failure?
这条还缺什么证据?
下面每条都由本条已有字段推出(等级、理由、商业模式、来源次数、是否演示), 本站不生成推测性结论;通用验证方法放在方法论页。
- 可核验的收入或付费证据查官网定价页与付费口径;第三方数据源(如 GetLatka)只作旁证,需标注来源与时点。
- 商业模式未定确认按席位/按用量/授权还是开源托管版收费;开源项目另查 LICENSE 与是否存在付费版。
- 只有单一来源找一手站点或其他渠道是否重复出现同一产品;社区热帖数量不等于商业进展。
通用验证清单(谁有这个问题/谁愿意付费/一个人能交付哪一小步)见我们的筛选方法。