hiw3c 日报精选
Latent Space RSS 全文

为律师构建AI——Legora首席技术官Jacob Lauritzen

原文标题 · Building AI for Lawyers - Jacob Lauritzen, CTO of Legora

无追踪的评估、百万单元格表格评测,以及按小时计费作为商业模式存在的漏洞

来源:Latent Space · latent.space

正文为英文,可一键机器翻译(仅首次需要等待)

In this episode, we chat with Jacob Lauritzen, CTO of Legora, following the announcement of their $550M Series E at an $8.8B valuation a couple weeks ago. We talk about what it takes to build AI agents for lawyers and what other people building agents can learn from that work.

Legora started in a Stockholm basement with a simple product: ChatGPT, Swedish law, and a search tool. Jacob had already been through YC with his own startup when he helped Max Junestrand with the application for Leya (now Legora). He later joined as head of engineering and is now CTO.

Today the agent drafts and edits Word documents, reviews thousands of contracts at once, and coordinates work between lawyers, their clients, and other agents. The company passed $100 million in ARR in April, less than 18 months after launch, and now has more than 1,800 customers. It raised $550 million in March at a $5.55 billion valuation, then another $550 million in October at an $8.8 billion valuation. Its latest acquisition, Wexler, was its fifth just this year.

We asked Jacob how you evaluate agents when you can't see your customers' data, which tasks still need better models, how legal engineers and forward deployed engineers split the work, and why the billable hour as a business model is being upended.


What changed for the billable hour?

When Jacob first read Leya's YC application, he had one piece of feedback: people had tried building legal tech a million times, and it never worked. If lawyers bill by the hour, getting faster means earning less. Why would they buy a tool that does that?

What changed, he says, is the pressure on firms. In the US, routine work like small reviews is already shifting to flat project fees. Some firms do it for free to hold on to the client. The money moves to M&A, litigation, and time spent with clients.

We asked whether that means firms will stop needing paralegals and junior lawyers. Jacob says that's not what Legora is seeing. A good junior is worth more today than two years ago because they get so much more done, just as in engineering.

Evals without access to customer data

Most teams improve their agents by reading traces. Legora can't read any. Almost everything users upload is confidential, and much of it belongs to the firm's clients, not the firm.

So the evals team has to recreate the kinds of work customers do. Three engineers and three lawyers build RL environments to simulate the work their customers do. One example is a 10,000-file data room where the agent runs due diligence and has to produce a report that catches the right red flags. The team plots the results on a heat map by practice area and task. A new model often gets better at some kinds of legal work and worse at others.

The team draws on a pool of about 100 legal engineers: lawyers who spent three or four years in big law, often with a CS degree. In production, Legora classifies failures into 10 to 20 known failure modes and runs cheap LLM-based checks behind feature flags.

Those restrictions also determine which infrastructure Legora can use. Everything runs on Azure because when Legora started, law firms wouldn't accept AWS or GCP, and Microsoft was already an approved vendor through 365.

Where smarter models still matter

Legora resisted a model picker for a long time before giving in. Jacob's view is that a lawyer shouldn't have to decide whether a contract is a Sonnet-high or an Opus-mid task. It's Legora's job to find the best available tradeoff between quality, cost, latency, governance, and regional availability.

He estimates that models already handle about 60% of legal work really well. For those tasks it's a cost and latency problem now. Complex analysis and editing across million-token contracts still need more intelligence.

Legora has started post-training open-weight models for narrow tasks like legal research, with no plans to train its own frontier model. For drafting, Jacob finds Fable and Opus too verbose. Astra is more concise. To address hallucinations, everything the agent writes gets a citation that highlights a bounding box in the source PDF, multiple layers down.

A few building blocks, many products

Six months into the job, Jacob showed the team a slide of the 300 Spartans and declared that Legora would stay at 20 engineers forever. It now has 100, and he says that still feels too small. His job now is to build a system where the team can ship just a few things and customers feel like they're getting a lot.

The team builds around a few primitives: projects that hold files, the agent, Tabular Review, and lists. Lists are a flexible Notion-style database with triggers and automations. Agents can create and read lists, and changes to a list can start an agent. Intake is a Slack bot that turns a request into a ticket on a list.

Tabular Review is the one the industry copied, down to the name. Each row is a document, each column is a question. Drop in 10,000 employment contracts and ask for the termination period, the IP assignment clause, and the severance terms. It supports up to a million cells, but starts with just 10 rows so you can fix your prompts before running the rest.

Legal engineers configure new products on these primitives without writing code. Even Wexler's fact intelligence product runs on the same building blocks.

Legal engineers first, forward deployed engineers second

Legora hired its first forward deployed engineer about nine months ago in New York: Di Qi, a two-time YC founder who worked on search at Meta. Legal engineers configure the product the way a power user would and don't write code. Forward deployed engineers write code into production, build integrations into a firm's CRM or document management system, and push what they learn back into the core product. They still don't touch client data.

When a big, engaged client signs, Legora assigns legal engineers to work with them and adds an FDE if the project needs one. Within a year, Jacob expects to have a rotating group of FDEs who sit with a client for a couple of months, build what they need, and move on.

Where this goes

In two years, Jacob thinks big enterprises will use Legora through tools like Claude Cowork, while law firms work inside Legora directly. He doesn't expect the labs to cut Legora off the way they've done to coding companies. For a $400 million M&A deal, he thinks people will still want Legora.

Show notes

Timestamps

• 0:00 Cold open
• 0:40 Meet Jacob Lauritzen, CTO of Legora
• 1:05 Starting out as underdogs in a Stockholm basement
• 1:54 How Legora grew from ChatGPT with Swedish law into a legal agent
• 4:12 The switch from assistant to agent
• 5:23 Which models Legora uses and why it added a model picker
• 7:48 Are today’s models good enough for lawyers?
• 8:20 What agents couldn’t do nine months ago
• 9:18 Testing the agent in simulated worlds and a 10,000-file data room
• 10:07 The evals team and Legora’s 100 legal engineers
• 11:03 When evals didn’t seem worth it and one release took citations from 70% to 99%
• 12:18 What legal practice could look like in five to ten years
• 14:18 Will the law firm partnership model survive?
• 16:40 What happens to paralegals and junior lawyers?
• 18:00 The billable hour and why earlier legal tech fell short
• 19:39 Where the money goes now
• 22:44 How Legora used its own product for acquisition diligence
• 23:59 How Swedish and American law firms differ
• 26:12 Product metrics when you can’t read the traces
• 27:41 Paraphrasing traces and narrowing failures down to 10 or 20 types
• 28:42 Why data privacy led Legora to run everything on Azure
• 30:04 Open-weight models and model arbitrage
• 30:55 Transcription models and why Legora doesn’t use ElevenLabs
• 33:33 The agent, Tabular Review, projects, and the Word add-in
• 34:24 How a lawyer uses Tabular Review
• 35:51 Why a spreadsheet works and what you learn from the first 10 rows
• 37:53 How the legal intake bot works in Slack
• 39:11 How agents create lists and lists start agents
• 40:15 Building products on those same pieces and acquiring Wexler
• 42:37 What forward-deployed engineers do at Legora
• 43:52 How legal engineers and forward-deployed engineers onboard a big client
• 46:43 What’s next for the forward-deployed team over the coming year
• 47:24 Why Legora resisted building APIs
• 49:26 Can the agent be the API?
• 50:12 The 300 Spartans slide and the plan to stay at 20 engineers
• 51:32 The bets nobody asked Legora to make
• 53:05 Post-training open-weight models for legal research
• 54:05 Search, retrieval, and late interaction
• 54:51 What makes a good legal agent harness and why drafting depends on search
• 56:25 Which model writes the best draft?
• 57:03 Hallucinations and Legora’s citation system
• 57:41 Do lawyers check the citations?
• 58:19 MapReduce or one big context window for a million-token contract?
• 1:00:16 Getting anonymized examples and the idea of buying a law firm for its data
• 1:01:53 Why Jacob advises against default embeddings
• 1:02:44 Will lawyers work in Legora or through Claude?
• 1:03:26 Will the model labs cut Legora off?
• 1:04:24 Law schools and scholarships for computer science majors
• 1:05:28 Hiring in New York, Stockholm, and London
• 1:06:09 Why most work eventually becomes legal work

Transcript

Automatically transcribed from the revised edit; names and wording may contain errors.

0:00 People were asking us about Mythos and everything, even though I think realistically a lot of legal work does not require Mythos level intelligence. Paralegals, gone. Yep. Junior lawyers, gone. I don't need them. That's actually not what we're seeing, and we had one problem where, like, it wouldn't cite properly, and so we were, like, next model release solved. It went from, like, 70% to, like, 99. It's just, like, we did nothing and, like, great. At least you're doing a, you know, $400,000,000 M and A transaction. You're gonna want Legora. We're just gonna be 20 engineers for the rest of the company's history, and, like, we're gonna beat everyone who's much bigger. We're a 100 engineers now, it feels like we're way too small. But it's something that I'm trying with is, like, how much of our product can just be the agent versus all the other stuff. Okay. We're here in the studio with special guests, Jacob Lauritzen, CTO of Legora. Did I get it right? Lauritzen? That's fine. Yeah. That's okay. I'm not Spanish. How... It's Danish. Yeah. Exactly. Does it have a special history? It just... No. Is like son son of. Son of. It's like you have son and... Yeah. So son of Lauritz. That's my name. Nice. We've crossed paths here and there. You you you spoke at AIE a few times, and, obviously, Legora is one of the fastest growing legal tech in history. Yep. And you said something at the start in a pre show that I thought was really interesting. You said that your origin is very European Mhmm. Even though, obviously, you're expanding in New York and SF. What feels different about your culture? I think we are, just at the core, probably very humble about what we're doing because we've always been the underdog from the very, beginning. No one believed the small startup in a basement in Stockholm was gonna, you know, outcompete this huge behemoth that was, like, way ahead of us in the US. So I think we've always been underdogs, so we've always been very humble. We've always sort of had to fight for our existence. I think it's something we've had to learn as we've also become more and more... As we've entered the US and been in the US a lot more is to be a little bit more bold and, like, tell the world how great we are, because it's... It doesn't come naturally to, I think, some of us.

1:30 I kinda wanna start by going over your guys' product, because I feel like with a lot of these, like, legal products, you know, they're kinda like under wraps, like, you know Yeah. You're not supposed to like show it. Yeah, if you could just talk about, like, what does the product look like, and maybe, like, how did you guys get there? Like like, what have been the product iterations that got you to where you are today? I think that would be really interesting. Yeah. Absolutely. The way everything started was ChatGPT with Swedish laws Okay. Search tool in it. That was literally the entire everything. And so that's where we started. We started with legal research, which is like a huge market, basically, in the world where lawyers spend a lot of time figuring out what are previous cases that look like this, what's the legal precedent, like, is this, you know, what have previous people done in these situations? That's extremely important