Gragi grades frontier models against a written rubric for each contract type below. 143 agreements across 11 categories. Each contract is graded with 3 NPCs and 50 tasks per NPC, for at least 150 graded tasks per contract. Total graded tasks: 21450.
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Sample data (SPA) | 3 | 1 | 3 |
| Share Purchase Agreement (SPA) | 50 | 3 | 150 |
| Asset Purchase Agreement (APA) | 50 | 3 | 150 |
| Stock Purchase Agreement | 50 | 3 | 150 |
| Merger Agreement | 50 | 3 | 150 |
| Joint Venture Agreement | 50 | 3 | 150 |
| Shareholders Agreement | 50 | 3 | 150 |
| Investment Agreement | 50 | 3 | 150 |
| Subscription Agreement | 50 | 3 | 150 |
| Founders Agreement | 50 | 3 | 150 |
| Equity Incentive Agreement | 50 | 3 | 150 |
| Loan Agreement | 50 | 3 | 150 |
| Convertible Note Agreement | 50 | 3 | 150 |
| SAFE Agreement | 50 | 3 | 150 |
| Security Agreement | 50 | 3 | 150 |
| IP Collateral Agreement | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Technology License Agreement | 50 | 3 | 150 |
| Patent License Agreement | 50 | 3 | 150 |
| Trademark License Agreement | 50 | 3 | 150 |
| Copyright License Agreement | 50 | 3 | 150 |
| Software License Agreement | 50 | 3 | 150 |
| SaaS Agreement | 50 | 3 | 150 |
| Know‑How License Agreement | 50 | 3 | 150 |
| Joint Development Agreement | 50 | 3 | 150 |
| Research and Development Agreement | 50 | 3 | 150 |
| Open Source License Agreement | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Technology Transfer Agreement | 50 | 3 | 150 |
| Technology Commercialization Agreement | 50 | 3 | 150 |
| Technology Evaluation Agreement | 50 | 3 | 150 |
| Technology Access Agreement | 50 | 3 | 150 |
| Technology Option Agreement | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Research and Development Agreement | 50 | 3 | 150 |
| Collaborative Research Agreement | 50 | 3 | 150 |
| Joint Research Agreement | 50 | 3 | 150 |
| Improvement Assignment Agreement | 50 | 3 | 150 |
| Improvement License Agreement | 50 | 3 | 150 |
| Derivative Technology Agreement | 50 | 3 | 150 |
| Follow‑on Innovation Agreement | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Distribution Agreement | 50 | 3 | 150 |
| Supply Agreement | 50 | 3 | 150 |
| Manufacturing Agreement | 50 | 3 | 150 |
| Reseller Agreement | 50 | 3 | 150 |
| Agency Agreement | 50 | 3 | 150 |
| Franchise Agreement | 50 | 3 | 150 |
| Commercial Representation Agreement | 50 | 3 | 150 |
| Strategic Partnership Agreement | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Master Services Agreement (MSA) | 50 | 3 | 150 |
| Professional Services Agreement | 50 | 3 | 150 |
| Consulting Agreement | 50 | 3 | 150 |
| Independent Contractor Agreement | 50 | 3 | 150 |
| Outsourcing Agreement | 50 | 3 | 150 |
| Managed Services Agreement | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Data Processing Agreement (DPA) | 50 | 3 | 150 |
| Data Sharing Agreement | 50 | 3 | 150 |
| Data Transfer Agreement | 50 | 3 | 150 |
| Cloud Services Agreement | 50 | 3 | 150 |
| Platform Services Agreement | 50 | 3 | 150 |
| API License Agreement | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Term Sheet | 50 | 3 | 150 |
| Unilateral Non‑Disclosure Agreement (NDA) | 50 | 3 | 150 |
| Mutual NDA | 50 | 3 | 150 |
| Confidentiality Agreement | 50 | 3 | 150 |
| Non‑Circumvention Agreement | 50 | 3 | 150 |
| Non‑Solicitation Agreement | 50 | 3 | 150 |
| Memorandum of Understanding (MoU) | 50 | 3 | 150 |
| Letter of Intent (LOI) | 50 | 3 | 150 |
| Heads of Agreement | 50 | 3 | 150 |
| Statement of Intent | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Employment Agreement | 50 | 3 | 150 |
| Fixed-Term Employment Agreement | 50 | 3 | 150 |
| Part-Time Employment Agreement | 50 | 3 | 150 |
| Remote Work Agreement | 50 | 3 | 150 |
| Hybrid Work Agreement | 50 | 3 | 150 |
| Secondment Agreement | 50 | 3 | 150 |
| Executive Employment Agreement | 50 | 3 | 150 |
| Non‑Compete Agreement | 50 | 3 | 150 |
| Employee Invention Assignment Agreement | 50 | 3 | 150 |
| Severance Agreement | 50 | 3 | 150 |
| Independent Contractor Agreement | 50 | 3 | 150 |
| Consulting Agreement | 50 | 3 | 150 |
| Freelancer Agreement | 50 | 3 | 150 |
| Advisor Agreement | 50 | 3 | 150 |
| Board Advisor Agreement | 50 | 3 | 150 |
| Bonus Agreement | 50 | 3 | 150 |
| Incentive Compensation Agreement | 50 | 3 | 150 |
| Commission Agreement | 50 | 3 | 150 |
| Sales Incentive Agreement | 50 | 3 | 150 |
| Deferred Compensation Agreement | 50 | 3 | 150 |
| Stock Option Agreement | 50 | 3 | 150 |
| Restricted Stock Agreement | 50 | 3 | 150 |
| Restricted Stock Unit Agreement | 50 | 3 | 150 |
| Equity Incentive Plan Agreement | 50 | 3 | 150 |
| Employee Share Purchase Agreement | 50 | 3 | 150 |
| Expatriate Employment Agreement | 50 | 3 | 150 |
| Relocation Agreement | 50 | 3 | 150 |
| Global Mobility Agreement | 50 | 3 | 150 |
| Employee Training Agreement | 50 | 3 | 150 |
| Tuition Reimbursement Agreement | 50 | 3 | 150 |
| Professional Development Agreement | 50 | 3 | 150 |
| Scholarship Agreement for Employees | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Real Estate Purchase Agreement | 50 | 3 | 150 |
| Commercial Property Purchase Agreement | 50 | 3 | 150 |
| Residential Property Purchase Agreement | 50 | 3 | 150 |
| Land Purchase Agreement | 50 | 3 | 150 |
| Installment Land Contract | 50 | 3 | 150 |
| Real Estate Option Agreement | 50 | 3 | 150 |
| Commercial Lease Agreement | 50 | 3 | 150 |
| Residential Lease Agreement | 50 | 3 | 150 |
| Industrial Lease Agreement | 50 | 3 | 150 |
| Ground Lease Agreement | 50 | 3 | 150 |
| Sublease Agreement | 50 | 3 | 150 |
| Property Management Agreement | 50 | 3 | 150 |
| Construction Agreement | 50 | 3 | 150 |
| Mortgage Agreement | 50 | 3 | 150 |
| Deed of Trust | 50 | 3 | 150 |
| Real Estate Loan Agreement | 50 | 3 | 150 |
| Construction Loan Agreement | 50 | 3 | 150 |
| Right of First Refusal Agreement | 50 | 3 | 150 |
| Right of First Offer Agreement | 50 | 3 | 150 |
| Contract / Agreement | Tasks per NPC | NPC | Total tasks |
|---|---|---|---|
| Clinical Trial Agreement | 50 | 3 | 150 |
| Pharmaceutical License Agreement | 50 | 3 | 150 |
| Government Contract | 50 | 3 | 150 |
| Public Procurement Agreement | 50 | 3 | 150 |
| Framework Agreement (Public Sector) | 50 | 3 | 150 |
| Public Concession Agreement | 50 | 3 | 150 |
| Public-Private Partnership Agreement (PPP) | 50 | 3 | 150 |
| Government Grant Agreement | 50 | 3 | 150 |
| Government Funding Agreement | 50 | 3 | 150 |
| Regulatory Compliance Agreement | 50 | 3 | 150 |
| Compliance Program Agreement | 50 | 3 | 150 |
| Code of Conduct Agreement | 50 | 3 | 150 |
| Ethics and Compliance Agreement | 50 | 3 | 150 |
| Anti-Bribery and Anti-Corruption Agreement | 50 | 3 | 150 |
| Environmental Compliance Agreement | 50 | 3 | 150 |
| Carbon Credit Agreement | 50 | 3 | 150 |
| Emissions Reduction Agreement | 50 | 3 | 150 |
| Environmental Monitoring Agreement | 50 | 3 | 150 |
| Sustainability Partnership Agreement | 50 | 3 | 150 |
| Telecommunications Interconnection Agreement | 50 | 3 | 150 |
| Spectrum License Agreement | 50 | 3 | 150 |
| Network Sharing Agreement | 50 | 3 | 150 |
| Infrastructure Access Agreement | 50 | 3 | 150 |
| Export Control Compliance Agreement | 50 | 3 | 150 |
| Sanctions Compliance Agreement | 50 | 3 | 150 |