MultiLegalPile: A 689GB Multilingual Legal Corpus
ACL 2024, Volume 1: Long Papers
What it adds
Combines four corpora and evaluates adapted multilingual and monolingual encoders.
Read with this limitation
No deduplication; legal-mC4 may overlap other subsets. No large generative model was pretrained.
- Jurisdiction tags
- United States · Canada · European Union · Switzerland · United Kingdom · Germany · France · Brazil
- Language
24 languages
Bulgarian · Czech · Danish · German · Greek · English · Spanish · Estonian · Finnish · French · Irish · Croatian · Hungarian · Italian · Lithuanian · Latvian · Maltese · Dutch · Polish · Portuguese · Romanian · Slovak · Slovenian · Swedish
Follow the source
Selected statements located in the linked primary sources. These results have not been independently reproduced here.
The corpus totals 689GB across 24 languages and 17 jurisdictions.
1 Contributions; 3.2 DescriptionFinal LEXTREME aggregate: Legal-XLM-R-large 59.5 versus XLM-R-large 59.3; improvement is small.
5.3 Evaluation on LEXTREME
Connected research
Related question
Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset
Both assemble legal corpora for language-model research; they differ in language coverage and research emphasis.
Entry status, source edition & rights
- Index entry
- Source-linked summary, prepared with agent assistance. Independent scholarly review is pending.
- Archive admission
- This bibliographic entry does not confer admission to the versioned archive.
- Edition inspected
- 10.18653/v1/2024.acl-long.805
- Reading coverage
- Canonical PDF sections 1-5, limitations, Appendix A disclosure, Appendix D/Table 8, Appendix E/Table 9; relevant references. Corresponding arXiv v3 HTML inspected selectively.
- Rights
- External references only. Papers and research artifacts remain with their original hosts; their own terms apply.
- Entry updated
- 2026-10-15
Source-linked summary · independent assessment pending.