Sample benchmark: Can we trust this model to edit our contracts?
A real run on synthetic contract cases: 5 synthetic contract cases × 3 models × 5 attempts, run 16 November 2026 at 18:45 SGT. The agreement, parties and terms are invented. Model spend for this run: US$2.00 including both graders.
Create my benchmark Download the report (PDF) The synthetic cases (JSONL)
ChatJudge sample benchmark on synthetic cases · Can we trust this model to edit our contracts? · version 1 · run 2026-11-16 18:45 SGT
Can we trust this model to edit our contracts?
5 cases × 3 models × 5 attempts = 75 candidate outputs, graded against what you said a good response must get right.
Summary
Meets your essential requirements: Claude Opus 5.5 (25/25 runs successful), GPT-6 Astra (25/25 runs successful) and Gemini 4 Carbon (25/25 runs successful).
Best quality: a tie between Gemini 4 Carbon, Claude Opus 5.5 and GPT-6 Astra (each met 100% of checks).
Lowest cost per successful task: Gemini 4 Carbon, $0.011 (failed attempts and retries included).
Fastest end to end: GPT-6 Astra, median 5.3 s per answer (9 in 10 within 9.4 s).
Inspect the outputs below before you choose a baseline. A recommendation never changes your baseline by itself.
Who meets your essential requirements
| Model (exact version) | Successful runs | Runs with a dealbreaker missed | Call errors | Meets requirements? |
|---|---|---|---|---|
| Gemini 4 Carbon Google · gemini-4-carbon · returned gemini-4-carbon | 25/25 (100%) | 0/25 | 0 | Yes |
| Claude Opus 5.5 Anthropic · claude-opus-5-5 · returned claude-opus-5-5 | 25/25 (100%) | 0/25 | 0 | Yes |
| GPT-6 Astra OpenAI · gpt-6-astra · returned gpt-6-astra | 25/25 (100%) | 0/25 | 0 | Yes |
A run is successful when every requirement you marked as a dealbreaker is met and at least 80% of all requirements are met. A model meets your essential requirements when at least 80% of its runs are successful. Ties and “none qualified” are reported as they are.
Important failures
No dealbreaker was missed and every call returned an answer.
Cost, speed and repeatability
| Model | Quality (requirements met) | Cost per successful task | Cost per attempt | End-to-end time, median / p90 | Cases with the same result in all 5 runs | Retries |
|---|---|---|---|---|---|---|
| Gemini 4 Carbon | 100% runs ranged 100–100% | $0.011 | $0.011 | 19 s / 32 s | 5 of 5 | 0 |
| Claude Opus 5.5 | 100% runs ranged 100–100% | $0.026 | $0.026 | 9.8 s / 11 s | 5 of 5 | 0 |
| GPT-6 Astra | 100% runs ranged 100–100% | $0.028 | $0.028 | 5.3 s / 9.4 s | 5 of 5 | 0 |
Cost per successful task = everything spent on that model’s attempts, failed attempts and retries included, divided by its successful runs. End-to-end time is measured from sending a case to receiving the full answer, including any retries. 75 planned attempts (5 cases × 3 models × 5 independent attempts); a retry is a repeat of an attempt after an error, not an extra attempt.
Second grader
To check how much the scores depend on the grader, every requirement judged by the grading model was graded again by a second grader outside the compared models, Claude Sonnet 5.5 (claude-sonnet-5-5). The two graders agreed on 60 of 60 verdicts, and on whether a run was successful for 45 of 45 runs that had grader-judged requirements. There was no material disagreement.
Case by case, with the outputs
1. Extend the initial term
Request: Extend the initial term from 12 to 24 months. Keep the renewal term at 12 months and leave pricing unchanged.
| Requirement | Claude Opus 5.5 | GPT-6 Astra | Gemini 4 Carbon |
|---|---|---|---|
| The initial term is 24 monthsdealbreaker Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i | 5/5 | 5/5 | 5/5 |
| The renewal term stays at 12 monthsdealbreaker Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” | 5/5 | 5/5 | 5/5 |
| Pricing is unchangeddealbreaker Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …” | 5/5 | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Gemini 4 Carbon · run 1 · successful · 100% of checks · 14 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Opus 5.5 · run 1 · successful · 100% of checks · 11 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 11 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Opus 5.5 · run 2 · successful · 100% of checks · 11 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Opus 5.5 · run 3 · successful · 100% of checks · 10 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Opus 5.5 · run 4 · successful · 100% of checks · 10 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Opus 5.5 · run 5 · successful · 100% of checks · 11 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
All 5 runs: GPT-6 Astra
GPT-6 Astra · run 1 · successful · 100% of checks · 5.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
GPT-6 Astra · run 2 · successful · 100% of checks · 5.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
GPT-6 Astra · run 3 · successful · 100% of checks · 6.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
GPT-6 Astra · run 4 · successful · 100% of checks · 5.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
GPT-6 Astra · run 5 · successful · 100% of checks · 5.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
All 5 runs: Gemini 4 Carbon
Gemini 4 Carbon · run 1 · successful · 100% of checks · 14 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Gemini 4 Carbon · run 2 · successful · 100% of checks · 10 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Gemini 4 Carbon · run 3 · successful · 100% of checks · 14 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Gemini 4 Carbon · run 4 · successful · 100% of checks · 26 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Gemini 4 Carbon · run 5 · successful · 100% of checks · 13 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
2. Fee increase from year two
Request: Increase the monthly subscription fee to US$5,250 from the start of the second year. Write the new amount in the same style as the existing one.
| Requirement | Claude Opus 5.5 | GPT-6 Astra | Gemini 4 Carbon |
|---|---|---|---|
| The new fee is US$5,250 per monthdealbreaker Checked by code: answer matches the pattern /US\$5,250/ | 5/5 | 5/5 | 5/5 |
| The current fee still applies in the first yeardealbreaker Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” | 5/5 | 5/5 | 5/5 |
| The new amount is written in words and figures, like the existing one Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i | 5/5 | 5/5 | 5/5 |
| The new fee starts only from the second year (month 13)dealbreaker Graded by the grading model | 5/5 | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Gemini 4 Carbon · run 1 · successful · 100% of checks · 32 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. From the start of the second year, the subscription fee shall increase to five thousand two hundred fifty US dollars (US$5,250) per month. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee clause explicitly states that the increase begins at the start of the second year.
Claude Opus 5.5 · run 1 · successful · 100% of checks · 9.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee begins at the start of the first renewal term, after the twelve-month Initial Term.
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 9.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee begins at the start of the first renewal term, after the twelve-month Initial Term.
Claude Opus 5.5 · run 2 · successful · 100% of checks · 10 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee begins at the start of the first renewal term, after the twelve-month Initial Term.
Claude Opus 5.5 · run 3 · successful · 100% of checks · 10 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The US$5,250 fee begins at the first renewal term, after the twelve-month Initial Term.
Claude Opus 5.5 · run 4 · successful · 100% of checks · 9.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee applies from the start of the first renewal term, after the twelve-month Initial Term.
Claude Opus 5.5 · run 5 · successful · 100% of checks · 11 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The US$5,250 fee begins at the start of the first renewal term, after the twelve-month Initial Term.
All 5 runs: GPT-6 Astra
GPT-6 Astra · run 1 · successful · 100% of checks · 5.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee applies from the start of the second year, while the original fee applies during the twelve-month Initial Term.
GPT-6 Astra · run 2 · successful · 100% of checks · 5.7 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee applies from the start of the second year, while the original fee applies during the twelve-month Initial Term.
GPT-6 Astra · run 3 · successful · 100% of checks · 4.6 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee clause keeps US$4,800 during the twelve-month Initial Term and starts US$5,250 at the beginning of the second year.
GPT-6 Astra · run 4 · successful · 100% of checks · 4.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised clause retains US$4,800 during the twelve-month Initial Term and starts US$5,250 at the beginning of the second year.
GPT-6 Astra · run 5 · successful · 100% of checks · 4.7 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee applies from the start of the second year; the original fee applies during the twelve-month Initial Term.
All 5 runs: Gemini 4 Carbon
Gemini 4 Carbon · run 1 · successful · 100% of checks · 32 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. From the start of the second year, the subscription fee shall increase to five thousand two hundred fifty US dollars (US$5,250) per month. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee clause explicitly states that the increase begins at the start of the second year.
Gemini 4 Carbon · run 2 · successful · 100% of checks · 28 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee applies from the start of the second year, after the twelve-month Initial Term.
Gemini 4 Carbon · run 3 · successful · 100% of checks · 25 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: Clause 4 keeps the original fee for the twelve-month Initial Term and starts the increased fee at the start of the second year.
Gemini 4 Carbon · run 4 · successful · 100% of checks · 27 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. From the start of the second year, the subscription fee increases to five thousand two hundred fifty US dollars (US$5,250) per month. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee clause states the increase begins from the start of the second year, after the twelve-month Initial Term.
Gemini 4 Carbon · run 5 · successful · 100% of checks · 24 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, increasing to five thousand two hundred fifty US dollars (US$5,250) per month from the start of the second year, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee clause specifies that the increase begins at the start of the second year, after the twelve-month Initial Term.
3. Delete a clause and renumber
Request: Delete clause 6 (Limitation of Liability) entirely. Renumber the clauses that follow and update any cross-references to them.
| Requirement | Claude Opus 5.5 | GPT-6 Astra | Gemini 4 Carbon |
|---|---|---|---|
| Clause 6 is gonedealbreaker Checked by code: answer does not contain “Limitation of Liability” | 5/5 | 5/5 | 5/5 |
| Termination for Convenience is renumbered to clause 6dealbreaker Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i | 5/5 | 5/5 | 5/5 |
| Governing Law is renumbered to clause 7dealbreaker Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i | 5/5 | 5/5 | 5/5 |
| The cross-reference in clause 2 now points to clause 6dealbreaker Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i | 5/5 | 5/5 | 5/5 |
| Confidentiality is unchangeddealbreaker Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…” | 5/5 | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Gemini 4 Carbon · run 1 · successful · 100% of checks · 14 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Opus 5.5 · run 1 · successful · 100% of checks · 5.9 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 5.9 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Opus 5.5 · run 2 · successful · 100% of checks · 6.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Opus 5.5 · run 3 · successful · 100% of checks · 6.2 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Opus 5.5 · run 4 · successful · 100% of checks · 6.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Opus 5.5 · run 5 · successful · 100% of checks · 6.9 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
All 5 runs: GPT-6 Astra
GPT-6 Astra · run 1 · successful · 100% of checks · 5.0 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
GPT-6 Astra · run 2 · successful · 100% of checks · 4.2 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
GPT-6 Astra · run 3 · successful · 100% of checks · 4.2 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
GPT-6 Astra · run 4 · successful · 100% of checks · 4.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
GPT-6 Astra · run 5 · successful · 100% of checks · 5.9 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
All 5 runs: Gemini 4 Carbon
Gemini 4 Carbon · run 1 · successful · 100% of checks · 14 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Gemini 4 Carbon · run 2 · successful · 100% of checks · 16 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Gemini 4 Carbon · run 3 · successful · 100% of checks · 13 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Gemini 4 Carbon · run 4 · successful · 100% of checks · 14 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Gemini 4 Carbon · run 5 · successful · 100% of checks · 14 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
4. Three negotiated changes and one conflict
Request: Incorporate these negotiated changes: (a) invoices are payable within 45 days instead of 30; (b) the liability cap becomes the fees paid in the 12 months before the claim instead of 6 months; (c) add that either party may terminate immediately by written notice if the other party commits a material breach that is not cured within 15 days of notice; (d) Supplier may increase the fees at any time on…
| Requirement | Claude Opus 5.5 | GPT-6 Astra | Gemini 4 Carbon |
|---|---|---|---|
| Invoices payable within 45 daysdealbreaker Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i | 5/5 | 5/5 | 5/5 |
| Liability cap uses the previous 12 months of feesdealbreaker Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i | 5/5 | 5/5 | 5/5 |
| Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” | 5/5 | 5/5 | 5/5 |
| Adds termination for uncured material breach (15 days to cure) Graded by the grading model | 5/5 | 5/5 | 5/5 |
| Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker Graded by the grading model | 5/5 | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Gemini 4 Carbon · run 1 · successful · 100% of checks · 22 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7 permits either party to terminate immediately by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE explicitly identifies the conflict between fee increases at any time and clause 4’s fixed fees during the Initial Term.
Claude Opus 5.5 · run 1 · successful · 100% of checks · 9.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination.
7.1 Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7.2 Termination for Breach. Either party may terminate this Agreement immediately by written notice to the other party if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days of receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7.2 allows either party to terminate immediately by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE flags that an increase at any time conflicts with clause 4’s fixed fees for the Initial Term.
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 9.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination.
7.1 Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7.2 Termination for Breach. Either party may terminate this Agreement immediately by written notice to the other party if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days of receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7.2 allows either party to terminate immediately by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE flags that an increase at any time conflicts with clause 4’s fixed fees for the Initial Term.
Claude Opus 5.5 · run 2 · successful · 100% of checks · 9.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Termination for Material Breach. Either party may terminate this Agreement immediately by written notice if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days after receiving written notice of it.
9. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
NOTE: Change (d) has not been applied. Clause 4 states that "the fees are fixed for the Initial Term." Allowing Supplier to increase fees at any time on 30 days' notice would contradict that. To proceed, the parties should either limit Supplier's right to increase fees to renewal terms (for example, on 30 days' notice before a renewal term begins) or agree to delete the fixed-fee commitment in clause 4. Also note that adding the new clause 8 (Termination for Material Breach) renumbered Governing Law to clause 9, and the cross-reference in clause 2 was updated to "clause 7 or clause 8."
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 8 allows either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between fee increases at any time and clause 4’s fixed fees for the Initial Term.
Claude Opus 5.5 · run 3 · successful · 100% of checks · 10 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Termination for Breach. Either party may terminate this Agreement immediately by written notice if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days after receiving written notice of it.
9. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
NOTE: Change (d) was not applied. It would let Supplier raise the fees at any time on 30 days' notice, but clause 4 states that "the fees are fixed for the Initial Term." These two provisions conflict. To resolve this, the parties could limit Supplier's right to increase fees to renewal terms only (for example, on 30 days' notice before a renewal term begins), or they could expressly remove the fixed-fee commitment. Changes (a), (b) and (c) were applied. Because the new termination-for-breach clause was added as clause 8, Governing Law has been renumbered as clause 9, and the cross-reference in clause 2 has been updated to include clause 8.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 8 permits either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between fee increases at any time and clause 4’s fixed fees during the Initial Term.
Claude Opus 5.5 · run 4 · successful · 100% of checks · 10 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination.
(a) Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
(b) Termination for Material Breach. Either party may terminate this Agreement with immediate effect by written notice to the other party if the other party commits a material breach of this Agreement and does not cure that breach within fifteen (15) days after receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7(b) permits either party to terminate by written notice for a material breach not cured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between increases at any time and clause 4’s fixed fees for the Initial Term.
Claude Opus 5.5 · run 5 · successful · 100% of checks · 10 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination.
7.1 Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7.2 Termination for Material Breach. Either party may terminate this Agreement immediately by written notice to the other party if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days after receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7.2 permits either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between increases at any time and clause 4’s fixed fees for the Initial Term.
All 5 runs: GPT-6 Astra
GPT-6 Astra · run 1 · successful · 100% of checks · 10 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Adds either party’s right to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The note identifies the conflict between increases at any time and clause 4’s fixed fees during the Initial Term.
GPT-6 Astra · run 2 · successful · 100% of checks · 9.4 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7 permits either party to terminate by written notice for a material breach uncured within fifteen days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between increases at any time and clause 4’s fixed fees during the Initial Term.
GPT-6 Astra · run 3 · successful · 100% of checks · 9.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7 permits either party to terminate by written notice for a material breach uncured within fifteen days after notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The note explicitly flags that the proposed fee increase conflicts with clause 4’s fixed fees during the Initial Term.
GPT-6 Astra · run 4 · successful · 100% of checks · 8.1 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Adds either party’s right to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The note identifies the conflict between fee increases at any time and fixed fees during the Initial Term.
GPT-6 Astra · run 5 · successful · 100% of checks · 8.4 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Either party may terminate by written notice for a material breach not cured within 15 days after notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between fee increases at any time and fixed fees during the Initial Term.
All 5 runs: Gemini 4 Carbon
Gemini 4 Carbon · run 1 · successful · 100% of checks · 22 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7 permits either party to terminate immediately by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE explicitly identifies the conflict between fee increases at any time and clause 4’s fixed fees during the Initial Term.
Gemini 4 Carbon · run 2 · successful · 100% of checks · 27 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7 allows either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The note identifies the conflict between change (d) and clause 4’s fixed fees during the Initial Term.
Gemini 4 Carbon · run 3 · successful · 100% of checks · 23 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7 allows either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The note identifies the conflict between increases at any time and fees fixed for the Initial Term.
Gemini 4 Carbon · run 4 · successful · 100% of checks · 12 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7 allows either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The note explicitly flags that fee increases at any time conflict with clause 4’s fixed fees during the Initial Term.
Gemini 4 Carbon · run 5 · successful · 100% of checks · 19 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7 permits either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The note identifies that change (d) conflicts with the fixed fees in clause 4.
5. Add a data protection clause
Request: Add a new clause 9 headed "Data Protection" requiring each party to comply with the Personal Data Protection Act 2012 (Singapore) when it processes personal data under this Agreement. Do not renumber or change clauses 1 to 8.
| Requirement | Claude Opus 5.5 | GPT-6 Astra | Gemini 4 Carbon |
|---|---|---|---|
| Adds clause 9 headed Data Protectiondealbreaker Checked by code: answer matches the pattern /9\.\s*Data Protection/i | 5/5 | 5/5 | 5/5 |
| Names the Personal Data Protection Act 2012dealbreaker Checked by code: answer contains “Personal Data Protection Act 2012” | 5/5 | 5/5 | 5/5 |
| Governing law clause is unchangeddealbreaker Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” | 5/5 | 5/5 | 5/5 |
| The obligation applies to both parties Graded by the grading model | 5/5 | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Gemini 4 Carbon · run 1 · successful · 100% of checks · 11 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both Supplier and Customer.
Claude Opus 5.5 · run 1 · successful · 100% of checks · 7.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party must comply when processing personal data under the Agreement.
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 7.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party must comply when processing personal data under the Agreement.
Claude Opus 5.5 · run 2 · successful · 100% of checks · 6.6 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both Supplier and Customer.
Claude Opus 5.5 · run 3 · successful · 100% of checks · 7.7 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both parties.
Claude Opus 5.5 · run 4 · successful · 100% of checks · 7.4 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, applying the obligation to both Supplier and Customer.
Claude Opus 5.5 · run 5 · successful · 100% of checks · 7.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both parties.
All 5 runs: GPT-6 Astra
GPT-6 Astra · run 1 · successful · 100% of checks · 6.0 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” expressly applying the obligation to both parties.
GPT-6 Astra · run 2 · successful · 100% of checks · 5.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both parties.
GPT-6 Astra · run 3 · successful · 100% of checks · 5.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both parties.
GPT-6 Astra · run 4 · successful · 100% of checks · 5.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, applying the obligation to both Supplier and Customer.
GPT-6 Astra · run 5 · successful · 100% of checks · 5.2 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, applying the obligation to both Supplier and Customer.
All 5 runs: Gemini 4 Carbon
Gemini 4 Carbon · run 1 · successful · 100% of checks · 11 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both Supplier and Customer.
Gemini 4 Carbon · run 2 · successful · 100% of checks · 40 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, applying the obligation to both Supplier and Customer.
Gemini 4 Carbon · run 3 · successful · 100% of checks · 17 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, applying the obligation to both Supplier and Customer.
Gemini 4 Carbon · run 4 · successful · 100% of checks · 38 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, so the obligation applies to both parties.
Gemini 4 Carbon · run 5 · successful · 100% of checks · 21 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, applying the obligation to both Supplier and Customer.
Method
Benchmark “Can we trust this model to edit our contracts?”, version 1: 5 cases. Every model received the same messages (your system prompt, then the case) through the Codegraff gateway (The Standard Harness Company of Singapore), with provider-default settings; 5 independent attempts per case per model; a failed call is retried up to 2 more times and every retry’s cost is counted. Requirements marked “Checked by code” are deterministic. The rest were graded blind by GPT-6 Sol (gpt-6-sol, returned gpt-6-sol; grading prompt tasks-judge-2026-11-16), which is never one of the models compared and never sees which model wrote an answer. Answer keys and requirements are never sent to the models being compared. Prices: list price per token from the gateway at run time. Spend on this report: models $1.63, grading $0.142. Synthetic cases; no customer data.
This applies to these cases only. It is not a general ranking of the models.
Second visit: “Should we switch?”
After the first report we chose Claude Opus 5.5 as the baseline and tested Claude Haiku 5.5 on the same cases (run 16 November 2026 at 18:46 SGT). The baseline’s results were reused from the run above (same cases, prompt, model, requirements and grader), so only the challenger ran: 5 cases × 5 attempts, US$0.065 in model and grading spend.
ChatJudge sample benchmark on synthetic cases · Can we trust this model to edit our contracts? · version 1 · run 2026-11-16 18:46 SGT
Can we trust this model to edit our contracts?
5 cases × 2 models × 5 attempts = 50 candidate outputs, graded against what you said a good response must get right.
Summary
Consider switching to Claude Haiku 5.5. Quality is level (100% against 100%) and Claude Haiku 5.5 costs 97% less per successful task. It succeeded on 25 of 25 runs.
Meets your essential requirements: Claude Opus 5.5 (25/25 runs successful) and Claude Haiku 5.5 (25/25 runs successful).
Best quality: a tie between Claude Haiku 5.5 and Claude Opus 5.5 (each met 100% of checks).
Lowest cost per successful task: Claude Haiku 5.5, $0.0007 (failed attempts and retries included).
Fastest end to end: Claude Haiku 5.5, median 4.2 s per answer (9 in 10 within 6.2 s).
Challenger against your baseline
Consider switching to Claude Haiku 5.5. Quality is level (100% against 100%) and Claude Haiku 5.5 costs 97% less per successful task.
| Case | Claude Opus 5.5 (baseline) | Claude Haiku 5.5 | Change |
|---|---|---|---|
| 1. Extend the initial term | 5/5 (reused) | 5/5 | same |
| 2. Fee increase from year two | 5/5 (reused) | 5/5 | same |
| 3. Delete a clause and renumber | 5/5 (reused) | 5/5 | same |
| 4. Three negotiated changes and one conflict | 5/5 (reused) | 5/5 | same |
| 5. Add a data protection clause | 5/5 (reused) | 5/5 | same |
Improved on 0 cases, regressed on 0. Cost per successful task 97% lower; median end-to-end time 57% faster.
Who meets your essential requirements
| Model (exact version) | Successful runs | Runs with a dealbreaker missed | Call errors | Meets requirements? |
|---|---|---|---|---|
| Claude Haiku 5.5 Anthropic · claude-haiku-5-5 · returned claude-haiku-5-5 | 25/25 (100%) | 0/25 | 0 | Yes |
| Claude Opus 5.5 baseline Anthropic · claude-opus-5-5 · returned claude-opus-5-5 | 25/25 (100%) | 0/25 | 0 | Yes |
A run is successful when every requirement you marked as a dealbreaker is met and at least 80% of all requirements are met. A model meets your essential requirements when at least 80% of its runs are successful. Ties and “none qualified” are reported as they are.
Important failures
No dealbreaker was missed and every call returned an answer.
Cost, speed and repeatability
| Model | Quality (requirements met) | Cost per successful task | Cost per attempt | End-to-end time, median / p90 | Cases with the same result in all 5 runs | Retries |
|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 100% runs ranged 100–100% | $0.0007 | $0.0007 | 4.2 s / 6.2 s | 5 of 5 | 0 |
| Claude Opus 5.5 | 100% runs ranged 100–100% | $0.026 | $0.026 | 9.8 s / 11 s | 5 of 5 | 0 25 runs reused |
Cost per successful task = everything spent on that model’s attempts, failed attempts and retries included, divided by its successful runs. End-to-end time is measured from sending a case to receiving the full answer, including any retries. 50 planned attempts (5 cases × 2 models × 5 independent attempts); a retry is a repeat of an attempt after an error, not an extra attempt.
Case by case, with the outputs
1. Extend the initial term
Request: Extend the initial term from 12 to 24 months. Keep the renewal term at 12 months and leave pricing unchanged.
| Requirement | Claude Opus 5.5 | Claude Haiku 5.5 |
|---|---|---|
| The initial term is 24 monthsdealbreaker Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i | 5/5 | 5/5 |
| The renewal term stays at 12 monthsdealbreaker Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” | 5/5 | 5/5 |
| Pricing is unchangeddealbreaker Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …” | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Claude Opus 5.5 · run 1 · successful · 100% of checks · 11 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 3.7 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 11 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Opus 5.5 · run 2 · successful · 100% of checks · 11 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Opus 5.5 · run 3 · successful · 100% of checks · 10 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Opus 5.5 · run 4 · successful · 100% of checks · 10 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Opus 5.5 · run 5 · successful · 100% of checks · 11 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
All 5 runs: Claude Haiku 5.5
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 3.7 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Haiku 5.5 · run 2 · successful · 100% of checks · 3.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Haiku 5.5 · run 3 · successful · 100% of checks · 3.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Haiku 5.5 · run 4 · successful · 100% of checks · 4.0 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
Claude Haiku 5.5 · run 5 · successful · 100% of checks · 4.0 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The initial term is 24 monthsdealbreaker
Checked by code: answer matches the pattern /initial term of (twenty-four \(24\)|24|twenty-four) months/i - The renewal term stays at 12 monthsdealbreaker
Checked by code: this text is kept word for word: “3. Renewal. After the Initial Term, this Agreement renews automatically for successive ren…” - Pricing is unchangeddealbreaker
Checked by code: this text is kept word for word: “4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US …”
2. Fee increase from year two
Request: Increase the monthly subscription fee to US$5,250 from the start of the second year. Write the new amount in the same style as the existing one.
| Requirement | Claude Opus 5.5 | Claude Haiku 5.5 |
|---|---|---|
| The new fee is US$5,250 per monthdealbreaker Checked by code: answer matches the pattern /US\$5,250/ | 5/5 | 5/5 |
| The current fee still applies in the first yeardealbreaker Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” | 5/5 | 5/5 |
| The new amount is written in words and figures, like the existing one Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i | 5/5 | 5/5 |
| The new fee starts only from the second year (month 13)dealbreaker Graded by the grading model | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Claude Opus 5.5 · run 1 · successful · 100% of checks · 9.8 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee begins at the start of the first renewal term, after the twelve-month Initial Term.
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 5.0 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee applies from the start of the second year; the original fee remains in effect during the twelve-month Initial Term.
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 9.8 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee begins at the start of the first renewal term, after the twelve-month Initial Term.
Claude Opus 5.5 · run 2 · successful · 100% of checks · 10 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee begins at the start of the first renewal term, after the twelve-month Initial Term.
Claude Opus 5.5 · run 3 · successful · 100% of checks · 10 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The US$5,250 fee begins at the first renewal term, after the twelve-month Initial Term.
Claude Opus 5.5 · run 4 · successful · 100% of checks · 9.3 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee applies from the start of the first renewal term, after the twelve-month Initial Term.
Claude Opus 5.5 · run 5 · successful · 100% of checks · 11 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The US$5,250 fee begins at the start of the first renewal term, after the twelve-month Initial Term.
All 5 runs: Claude Haiku 5.5
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 5.0 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee applies from the start of the second year; the original fee remains in effect during the twelve-month Initial Term.
Claude Haiku 5.5 · run 2 · successful · 100% of checks · 4.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. From the first day of the second year of this Agreement, the subscription fee is five thousand two hundred fifty US dollars (US$5,250) per month. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised clause retains the original fee for the twelve-month Initial Term and starts the new fee on the first day of the second year.
Claude Haiku 5.5 · run 3 · successful · 100% of checks · 5.2 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The agreement keeps US$4,800 during the twelve-month Initial Term and applies US$5,250 from the start of the second year.
Claude Haiku 5.5 · run 4 · successful · 100% of checks · 5.0 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised fee applies from the first day of the second year; the original fee applies during the twelve-month Initial Term.
Claude Haiku 5.5 · run 5 · successful · 100% of checks · 4.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. With effect from the first day of the second year of this Agreement, the subscription fee shall be five thousand two hundred fifty US dollars (US$5,250) per month. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- The new fee is US$5,250 per monthdealbreaker
Checked by code: answer matches the pattern /US\$5,250/ - The current fee still applies in the first yeardealbreaker
Checked by code: this text is kept word for word: “four thousand eight hundred US dollars (US$4,800) per month” - The new amount is written in words and figures, like the existing one
Checked by code: answer matches the pattern /five thousand two hundred (and )?fifty US dollars \(US\$5,250\)/i - The new fee starts only from the second year (month 13)dealbreaker
Graded by the grading model · grader: The revised clause makes the new fee effective on the first day of the second year, after the twelve-month Initial Term.
3. Delete a clause and renumber
Request: Delete clause 6 (Limitation of Liability) entirely. Renumber the clauses that follow and update any cross-references to them.
| Requirement | Claude Opus 5.5 | Claude Haiku 5.5 |
|---|---|---|
| Clause 6 is gonedealbreaker Checked by code: answer does not contain “Limitation of Liability” | 5/5 | 5/5 |
| Termination for Convenience is renumbered to clause 6dealbreaker Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i | 5/5 | 5/5 |
| Governing Law is renumbered to clause 7dealbreaker Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i | 5/5 | 5/5 |
| The cross-reference in clause 2 now points to clause 6dealbreaker Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i | 5/5 | 5/5 |
| Confidentiality is unchangeddealbreaker Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…” | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Claude Opus 5.5 · run 1 · successful · 100% of checks · 5.9 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 3.7 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 5.9 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Opus 5.5 · run 2 · successful · 100% of checks · 6.3 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Opus 5.5 · run 3 · successful · 100% of checks · 6.2 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Opus 5.5 · run 4 · successful · 100% of checks · 6.5 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Opus 5.5 · run 5 · successful · 100% of checks · 6.9 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
All 5 runs: Claude Haiku 5.5
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 3.7 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Haiku 5.5 · run 2 · successful · 100% of checks · 3.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Haiku 5.5 · run 3 · successful · 100% of checks · 3.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Haiku 5.5 · run 4 · successful · 100% of checks · 3.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
Claude Haiku 5.5 · run 5 · successful · 100% of checks · 3.4 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6.
7.
- Clause 6 is gonedealbreaker
Checked by code: answer does not contain “Limitation of Liability” - Termination for Convenience is renumbered to clause 6dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*6\.\s*Termination for Convenience/i - Governing Law is renumbered to clause 7dealbreaker
Checked by code: answer matches the pattern /(^|\n)\s*7\.\s*Governing Law/i - The cross-reference in clause 2 now points to clause 6dealbreaker
Checked by code: answer matches the pattern /terminated earlier under clause 6\b/i - Confidentiality is unchangeddealbreaker
Checked by code: this text is kept word for word: “5. Confidentiality. Each party shall keep the other party's Confidential Information confi…”
4. Three negotiated changes and one conflict
Request: Incorporate these negotiated changes: (a) invoices are payable within 45 days instead of 30; (b) the liability cap becomes the fees paid in the 12 months before the claim instead of 6 months; (c) add that either party may terminate immediately by written notice if the other party commits a material breach that is not cured within 15 days of notice; (d) Supplier may increase the fees at any time on…
| Requirement | Claude Opus 5.5 | Claude Haiku 5.5 |
|---|---|---|
| Invoices payable within 45 daysdealbreaker Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i | 5/5 | 5/5 |
| Liability cap uses the previous 12 months of feesdealbreaker Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i | 5/5 | 5/5 |
| Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” | 5/5 | 5/5 |
| Adds termination for uncured material breach (15 days to cure) Graded by the grading model | 5/5 | 5/5 |
| Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker Graded by the grading model | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Claude Opus 5.5 · run 1 · successful · 100% of checks · 9.8 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination.
7.1 Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7.2 Termination for Breach. Either party may terminate this Agreement immediately by written notice to the other party if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days of receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7.2 allows either party to terminate immediately by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE flags that an increase at any time conflicts with clause 4’s fixed fees for the Initial Term.
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 6.2 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7A. Termination for Material Breach. Either party may terminate this Agreement with immediate effect by written notice to the other party if the other party commits a material breach of this Agreement that is not cured within fifteen (15) days after receipt of written notice of the breach.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7A permits either party to terminate immediately by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between increases at any time and clause 4’s fixed fees during the Initial Term.
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 9.8 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination.
7.1 Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7.2 Termination for Breach. Either party may terminate this Agreement immediately by written notice to the other party if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days of receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7.2 allows either party to terminate immediately by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE flags that an increase at any time conflicts with clause 4’s fixed fees for the Initial Term.
Claude Opus 5.5 · run 2 · successful · 100% of checks · 9.8 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Termination for Material Breach. Either party may terminate this Agreement immediately by written notice if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days after receiving written notice of it.
9. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
NOTE: Change (d) has not been applied. Clause 4 states that "the fees are fixed for the Initial Term." Allowing Supplier to increase fees at any time on 30 days' notice would contradict that. To proceed, the parties should either limit Supplier's right to increase fees to renewal terms (for example, on 30 days' notice before a renewal term begins) or agree to delete the fixed-fee commitment in clause 4. Also note that adding the new clause 8 (Termination for Material Breach) renumbered Governing Law to clause 9, and the cross-reference in clause 2 was updated to "clause 7 or clause 8."
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 8 allows either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between fee increases at any time and clause 4’s fixed fees for the Initial Term.
Claude Opus 5.5 · run 3 · successful · 100% of checks · 10 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Termination for Breach. Either party may terminate this Agreement immediately by written notice if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days after receiving written notice of it.
9. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
NOTE: Change (d) was not applied. It would let Supplier raise the fees at any time on 30 days' notice, but clause 4 states that "the fees are fixed for the Initial Term." These two provisions conflict. To resolve this, the parties could limit Supplier's right to increase fees to renewal terms only (for example, on 30 days' notice before a renewal term begins), or they could expressly remove the fixed-fee commitment. Changes (a), (b) and (c) were applied. Because the new termination-for-breach clause was added as clause 8, Governing Law has been renumbered as clause 9, and the cross-reference in clause 2 has been updated to include clause 8.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 8 permits either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between fee increases at any time and clause 4’s fixed fees during the Initial Term.
Claude Opus 5.5 · run 4 · successful · 100% of checks · 10 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination.
(a) Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
(b) Termination for Material Breach. Either party may terminate this Agreement with immediate effect by written notice to the other party if the other party commits a material breach of this Agreement and does not cure that breach within fifteen (15) days after receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7(b) permits either party to terminate by written notice for a material breach not cured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between increases at any time and clause 4’s fixed fees for the Initial Term.
Claude Opus 5.5 · run 5 · successful · 100% of checks · 10 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination.
7.1 Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7.2 Termination for Material Breach. Either party may terminate this Agreement immediately by written notice to the other party if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days after receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7.2 permits either party to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between increases at any time and clause 4’s fixed fees for the Initial Term.
All 5 runs: Claude Haiku 5.5
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 6.2 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7A. Termination for Material Breach. Either party may terminate this Agreement with immediate effect by written notice to the other party if the other party commits a material breach of this Agreement that is not cured within fifteen (15) days after receipt of written notice of the breach.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7A permits either party to terminate immediately by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between increases at any time and clause 4’s fixed fees during the Initial Term.
Claude Haiku 5.5 · run 2 · successful · 100% of checks · 5.8 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7A. Termination for Material Breach. Either party may terminate this Agreement immediately by written notice to the other party if the other party commits a material breach of this Agreement that is not cured within fifteen (15) days of notice of the breach.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7A allows either party to terminate immediately by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE expressly identifies the conflict between increases at any time and clause 4’s fixed fees during the Initial Term.
Claude Haiku 5.5 · run 3 · successful · 100% of checks · 6.1 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7A. Termination for Material Breach. Either party may terminate this Agreement with immediate effect by written notice to the other party if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days after receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7A permits either party to terminate immediately by written notice after an uncured material breach and a 15-day cure period. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE explicitly identifies the conflict between increases at any time and clause 4’s fixed fees during the Initial Term.
Claude Haiku 5.5 · run 4 · successful · 100% of checks · 7.0 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
7A. Termination for Material Breach. Either party may terminate this Agreement with immediate effect by written notice to the other party if the other party commits a material breach of this Agreement and fails to cure that breach within fifteen (15) days after receiving written notice of it.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Clause 7A permits either party to terminate immediately by written notice after an uncured material breach and a 15-day cure period. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies change (d) as conflicting with clause 4’s fixed fees during the Initial Term.
Claude Haiku 5.5 · run 5 · successful · 100% of checks · 6.9 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the
7.
Either party may terminate this Agreement immediately by written notice to the other party if the other party commits a material breach of this Agreement that is not cured within fifteen (15) days after written notice of the breach.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Invoices payable within 45 daysdealbreaker
Checked by code: answer matches the pattern /payable within (forty-five \(45\)|45) days/i - Liability cap uses the previous 12 months of feesdealbreaker
Checked by code: answer matches the pattern /fees paid[^.]*(twelve \(12\)|12) months/i - Keeps fees fixed for the Initial Term (does not apply change d)dealbreaker
Checked by code: this text is kept word for word: “The fees are fixed for the Initial Term.” - Adds termination for uncured material breach (15 days to cure)
Graded by the grading model · grader: Adds either party’s right to terminate by written notice for a material breach uncured within 15 days of notice. - Flags that change (d) conflicts with the fixed fees in clause 4dealbreaker
Graded by the grading model · grader: The NOTE identifies the conflict between increases at any time and clause 4’s fixed fees during the Initial Term.
5. Add a data protection clause
Request: Add a new clause 9 headed "Data Protection" requiring each party to comply with the Personal Data Protection Act 2012 (Singapore) when it processes personal data under this Agreement. Do not renumber or change clauses 1 to 8.
| Requirement | Claude Opus 5.5 | Claude Haiku 5.5 |
|---|---|---|
| Adds clause 9 headed Data Protectiondealbreaker Checked by code: answer matches the pattern /9\.\s*Data Protection/i | 5/5 | 5/5 |
| Names the Personal Data Protection Act 2012dealbreaker Checked by code: answer contains “Personal Data Protection Act 2012” | 5/5 | 5/5 |
| Governing law clause is unchangeddealbreaker Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” | 5/5 | 5/5 |
| The obligation applies to both parties Graded by the grading model | 5/5 | 5/5 |
| Successful runs | 5/5 | 5/5 |
Side by side: the typical run of each model (the run closest to its median score on this case). Redline against the original: removed added.
Claude Opus 5.5 · run 1 · successful · 100% of checks · 7.5 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party must comply when processing personal data under the Agreement.
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 4.1 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, applying the obligation to both parties.
All 5 runs: Claude Opus 5.5
Claude Opus 5.5 · run 1 · successful · 100% of checks · 7.5 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party must comply when processing personal data under the Agreement.
Claude Opus 5.5 · run 2 · successful · 100% of checks · 6.6 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both Supplier and Customer.
Claude Opus 5.5 · run 3 · successful · 100% of checks · 7.7 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both parties.
Claude Opus 5.5 · run 4 · successful · 100% of checks · 7.4 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, applying the obligation to both Supplier and Customer.
Claude Opus 5.5 · run 5 · successful · 100% of checks · 7.8 s · reused from version 1
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both parties.
All 5 runs: Claude Haiku 5.5
Claude Haiku 5.5 · run 1 · successful · 100% of checks · 4.1 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that each party shall comply, applying the obligation to both parties.
Claude Haiku 5.5 · run 2 · successful · 100% of checks · 4.1 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 requires each party to comply when processing personal data under the Agreement.
Claude Haiku 5.5 · run 3 · successful · 100% of checks · 4.5 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both parties.
Claude Haiku 5.5 · run 4 · successful · 100% of checks · 4.3 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 says “Each party shall comply,” applying the obligation to both parties.
Claude Haiku 5.5 · run 5 · successful · 100% of checks · 4.2 s
This Services Agreement is made between Northwind Analytics Pte. Ltd. ("Supplier") and Harbourline Logistics Pte. Ltd. ("Customer").
1. Services. Supplier shall provide the route-analytics platform and support described in Schedule 1 (the "Services").
2. Term. This Agreement starts on the Effective Date and continues for an initial term of twelve (12) months (the "Initial Term"), unless terminated earlier under clause 7.
3. Renewal. After the Initial Term, this Agreement renews automatically for successive renewal terms of twelve (12) months each, unless either party gives written notice of non-renewal at least thirty (30) days before the end of the then-current term.
4. Fees. Customer shall pay Supplier a subscription fee of four thousand eight hundred US dollars (US$4,800) per month, invoiced monthly in advance. The fees are fixed for the Initial Term. Invoices are payable within thirty (30) days of the invoice date.
5. Confidentiality. Each party shall keep the other party's Confidential Information confidential and use it only to perform this Agreement. This obligation survives for three (3) years after this Agreement ends.
6. Limitation of Liability. Except for breach of clause 5, each party's total liability under this Agreement is limited to the fees paid by Customer in the six (6) months before the event giving rise to the claim.
7. Termination for Convenience. Customer may terminate this Agreement for convenience after the Initial Term by giving Supplier thirty (30) days' written notice.
8. Governing Law. This Agreement is governed by the laws of England and Wales, and the courts of England and Wales have exclusive jurisdiction.
- Adds clause 9 headed Data Protectiondealbreaker
Checked by code: answer matches the pattern /9\.\s*Data Protection/i - Names the Personal Data Protection Act 2012dealbreaker
Checked by code: answer contains “Personal Data Protection Act 2012” - Governing law clause is unchangeddealbreaker
Checked by code: this text is kept word for word: “8. Governing Law. This Agreement is governed by the laws of England and Wales, and the cou…” - The obligation applies to both parties
Graded by the grading model · grader: Clause 9 states that “Each party” shall comply, applying the obligation to both Supplier and Customer.
Method
Benchmark “Can we trust this model to edit our contracts?”, version 1: 5 cases. Every model received the same messages (your system prompt, then the case) through the Codegraff gateway (The Standard Harness Company of Singapore), with provider-default settings; 5 independent attempts per case per model; a failed call is retried up to 2 more times and every retry’s cost is counted. Requirements marked “Checked by code” are deterministic. The rest were graded blind by GPT-6 Sol (gpt-6-sol, returned gpt-6-sol; grading prompt tasks-judge-2026-11-16), which is never one of the models compared and never sees which model wrote an answer. Answer keys and requirements are never sent to the models being compared. Prices: list price per token from the gateway at run time. Spend on this report: models $0.017, grading $0.048. Synthetic cases; no customer data.
This applies to these cases only. It is not a general ranking of the models.
