AI-Powered Lawyering: AI Reasoning Models, Retrieval Augmented Generation, and the Future of Legal Practice
Journal of Law & Empirical Analysis 3(1), 220–250
What it adds
A randomized study tests whether upper-level law students produce better work with Vincent AI or o1-preview. It separates speed, accuracy and other quality dimensions across six realistic assignments.
Read with this limitation
Participants were students at two selective US law schools, not practising lawyers handling client matters. Effects varied by task; the tested tools date to October 2024. Subjective grading and fixed task order also limit generalization.
- Jurisdiction tags
- United States
- Language
- English
Follow the source
Selected statements located in the linked primary sources. These results have not been independently reproduced here.
137 students completed at least one task; 125 completed all six.
3. Methodology; Table 1The study found no statistically significant speed or quality benefit on its NDA drafting task.
4. Results; 5. Limitations
Connected research
Cites
Generative AI and Legal Aid: Results from a Field Study and 100 Use Cases to Bridge the Access to Justice Gap
Cites the legal-aid field study as prior evidence on AI use in practice.
Inspect the sourceCites
LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
Distinguishes model benchmarking from measuring the performance of people using AI.
Inspect the sourceRelated question
Does AI Assistance Enhance or Erode Expertise? Evidence from a Three-Month Field Experiment in Patent Drafting
Both examine AI-assisted legal work. The patent-drafting experiment adds sustained exposure and an unassisted assessment of practicing lawyers. The connection is thematic, not a citation claim.
Related question
Building a better lawyer: Experimental evidence that artificial intelligence can increase legal work efficiency
Both study AI-assisted student legal work. Building a better lawyer isolates the presentation of assistance. The relationship is thematic, not a citation claim.
Entry status, source edition & rights
- Index entry
- Source-linked summary, prepared with agent assistance. Independent scholarly review is pending.
- Archive admission
- This bibliographic entry does not confer admission to the versioned archive.
- Edition inspected
- 10.1177/2755323X261427048
- Reading coverage
- Publisher full HTML inspected: methods, results, limitations and references. Journal edition dated April 2026; earlier 2025 drafts are not treated as identical.
- Rights
- External links only; no full text mirrored on the Site. Publisher labels the article CC BY-NC 4.0.
- Entry updated
- 2026-10-15
Source-linked summary · independent assessment pending.