GenieAI vs Claude Cowork on a contract renegotiation
A supplier, Halcyon, receives its client Vantor's redline of a framework agreement plus a new project contract (SOW 14), and needs a position before Thursday's call. Same case, same documents, same request, same judge, same 11 checks.
HAL-8a is a test case with fictional parties. It's built around the kind of call a commercial team faces every week: the client has redlined the terms, a new project is waiting to start, and the supplier needs to know where it stands before it gets on the phone. Both products got the same documents and the same request, and both answers were scored against the same 11 checks.
The short version
- Cowork read most of the case correctly, including the fabricated statute, the SOW 9 precedent, the renewal deadline and the cap figures. Three checks separate the products.
- Insurance. Both saw that Halcyon's cover falls short of the liability cap. Only Genie told Halcyon what to do about it, which is to ask its broker.
- Legal basis. Once the invented Act was set aside, only Genie said why a 60-day payment term is lawful.
- The misdirected email. Both flagged it as sent by mistake, but Cowork then repeated its protected content to the client. Genie didn't.
- Cowork answered in under four minutes. Genie took 21 minutes and asked three clarifying questions first.
What the difference means in practice
An insurance gap only surfaces after a claim. Here, a professional claim between £5m and the cap would be uninsured. Spotting the number without saying who to call leaves the next step to the reader.
Genie also went further on SOW 14 itself. It flagged missing practical-completion terms and unseen appendices, and noted that change-control, termination and IP terms were absent. Where it needed facts it didn't have, it asked before assuming.
Speed and cost, plainly
| GenieAI | Claude Cowork | |
|---|---|---|
| Result | Pass, 11/11 | Fail, 8/11 |
| Time to answer | 21 min | 3 min 44 s |
| Cost | $5.64 model spend | Not measured (subscription) |
| Output | Review saved in the workspace, plus a chat summary | Chat answer only |
| Clarifying questions asked | 3, in 2 batches | None |
Speed favours Cowork, and we show it as it is. Genie's clarifying questions are part of its 21 minutes.
Check-by-check scorecard
Each line is one thing a careful lawyer would expect to see. Select a line to read what each product actually did. G is GenieAI, C is Claude Cowork.
1Recognised that 60-day payment sits at Halcyon's walk-away lineCriticalG Pass · C Pass
Why it matters. Halcyon's own playbook accepts 45 days and walks away at 60.
Named the fallback (45 acceptable, walk away at 60), said the redline lands exactly on the walk-away point and recommended declining.
Named both fallback positions, said 60 days is the walk-away line, and recommended pushing back.
2Flagged the insurance gap and told Halcyon to check with its brokerCriticalG Pass · C Miss
Why it matters. Halcyon carries £5m per-claim professional indemnity cover, and the liability cap is about £9m after the redline. Any higher cover is Halcyon's cost.
Compared £5m cover with the cap (about £4m uninsured after the redline), flagged uninsured design claims, and told Halcyon to ask its broker what raising cover would cost, rather than volunteering a higher level.
Compared the £5m and £10m minimums with the £9m to £13.5m cap and called the gap “uninsured”, but never recommended confirming cover with the broker or insurer.
3Said the non-renewal deadline has already passedImportantG Pass · C Pass
Why it matters. The framework has quietly renewed to October 2027, whatever is agreed on Thursday.
Stated unprompted that the 16 July 2026 deadline had passed and the framework renews on current terms.
Stated the same, unprompted, and explained what it means for leverage on the call.
4Led with a clear, usable position for ThursdayMinorG Pass · C Pass
Why it matters. The client wants a straight answer, not a memo.
Opened with a short bottom line, ranked issues by severity and ended with concrete next steps.
Opened with a bottom line, then a clause table with a stance for each change and the pre-call items separated out.
5Did not rely on the non-existent “Construction Payment Fairness Act 2024”CriticalG Pass · C Pass
Why it matters. Vantor cited it to justify 60 days. No such Act exists.
Searched legislation.gov.uk, found nothing, and advised asking Vantor to name the statute.
Couldn't find it, didn't treat it as the legal basis, and said the payment argument stands on its own.
6Treated the earlier SOW 9 cap as a one-off, not a precedentCriticalG Pass · C Pass
Why it matters. SOW 9's lower cap was traded for faster payment. This redline slows payment and offers nothing in return.
Explained it was SOW-only and exchanged for accelerated payment, while the redline makes it permanent and slows payment.
Called it a one-off, tied the figure to accelerated payment milestones, and advised deleting SOW 14's “Precedent” clause.
7Saw the clause 11.3 change is cosmeticImportantG Pass · C Pass
Why it matters. Another clause already required discretion to be exercised reasonably.
Described it as largely repeating the existing clause and advised accepting it.
Said it's worth nothing because the other clause already imports reasonableness, and advised giving nothing in return.
8Explained that 60 days is lawful, with a reasonImportantG Pass · C Miss
Why it matters. Once the invented Act is set aside, there must still be a legal answer.
Cited the freedom to agree payment periods under the construction payment legislation and treated 60 days as a commercial ask.
Never said whether a 60-day term is lawful. Its only legal point was a Bill not yet in force, and it leaned on the misdirected internal email for the idea that 60 days is a commercial ask.
9Got the liability-cap and delay-damages figures right, from Halcyon's sideCriticalG Pass · C Pass
Why it matters. The cap is mutual. Cutting it lowers Halcyon's own worst case, but it's still far above Halcyon's fallback.
Gave about £13.5m now, about £9m redlined and a £1.2m delay-damages ceiling. It correctly said the cut helps Halcyon and measured £9m against Halcyon's £800k to £2m limits.
Gave both cap figures and the £1.2m ceiling, and correctly said the cap is mutual and the cut lowers Halcyon's own exposure.
10Confirmed insurance before signing SOW 14MinorG Pass · C Pass
Why it matters. Exposure starts when Halcyon countersigns, and works begin within days.
Told Halcyon to speak to the broker before Thursday's call and not to sign before the appendices are seen.
Passed by default. It never recommended the check at all, so there's no timing to fault. The miss is counted once, under check 2.
11Handled the misdirected Vantor internal email properlyCriticalG Pass · C Miss
Why it matters. A confidential email from Vantor's own lawyer reached Halcyon by mistake. It should be acknowledged and not used.
Told the client twice that it was Vantor's internal correspondence and wasn't relied on, and still completed the task.
Acknowledged that the email looked like Vantor's internal advice sent by mistake, but then told the client the two protected points: Vantor's 100% walk-away on the cap, and its admission that the 60-day term is commercial, not legal. Telling the client “you don't need it” doesn't undo that.
How we ran the test
- HAL-8a is an authored test case with fictional parties.
- Same case, documents, request and 11 checks (the case author's 9 October 2026 version) for both products.
- We compared one run of each product, so this is a single sample, not an average. Cowork's run was from 3 October 2026 and was judged on 12 October against the current checks.
- The judge is Claude Opus 5.5. Cowork also runs on Claude, so the judge isn't a neutral third-party model.
- Cowork ran in default mode (no legal skills). Genie ran its 13 October 2026 release build.
- Check 10 passed Cowork by default because it never recommended the broker check at all. That miss is counted once, under check 2.
- This is one case. It doesn't prove how either product performs on every matter, and the outputs need review by qualified counsel.
Plain-English glossary
- Framework agreement
- The master contract setting general terms for all projects between two companies.
- SOW (statement of work)
- A project-specific contract issued under a framework agreement.
- Redline
- A marked-up draft showing the changes one side proposes.
- Walk-away position
- The point beyond which a party's internal playbook says not to agree.
- Liability cap
- The maximum total amount a party can owe the other for breach.
- Liquidated damages
- A pre-agreed daily or weekly sum payable for delay.
- Professional indemnity (PI) insurance
- Cover for claims arising from professional or design advice and work.
- Misdirected email
- A confidential message sent to the wrong recipient. It should be acknowledged and not used.
See how GenieAI handles your own contracts
No credit card required - 30-second signup