The February 2025 California bar exam was supposed to be a milestone for aspiring lawyers. Instead, it became a cautionary tale about the intersection of technology and tradition in the legal world. When the State Bar of California revealed that artificial intelligence (AI) had been used to help develop some of the exam’s multiple-choice questions, it sparked a wave of concern and debate—especially after the test was marred by widespread technical failures.
The AI Admission: A First for Legal Testing
For the first time, the State Bar acknowledged that 23 of the scored multiple-choice questions were created with the assistance of AI, in partnership with a psychometric consulting firm. The intention was to streamline the question development process, but the revelation that non-lawyers and AI were involved in drafting questions left many in the legal community uneasy.
Mary Basick, assistant dean at UC Irvine Law School, summed up the sentiment: “Having the questions drafted by non-lawyers using artificial intelligence is just unbelievable.” The news raised questions about the standards and oversight in place when using AI for such high-stakes assessments.
Technical Glitches Compound the Controversy
The controversy didn’t end with AI-generated questions. Many test-takers faced a barrage of technical issues: online platforms crashed, essays couldn’t be saved, and error messages popped up at the worst possible moments. For some, the exam was over before it even began.
These disruptions led to a flood of complaints and prompted the State Bar to recommend score adjustments for those affected. The California Supreme Court is now being asked to approve these changes, aiming to ensure fairness for all candidates.
Expert Opinions: Caution and Opportunity
While some experts were shocked by the use of AI, others saw it as an inevitable step in the evolution of legal education. Andrew Perlman, dean of Suffolk University Law School, noted that AI can be a valuable tool for developing assessment questions—provided there are strong guardrails and expert review.
Katie Moran, a bar exam preparation specialist, expressed concern about the lack of transparency and the potential for conflicts of interest when the same company both creates and approves exam questions. The consensus among experts is clear: human oversight is essential when integrating AI into critical processes like legal testing.
What Does This Mean for Future Exams?
The State Bar maintains confidence in the validity of the AI-assisted questions, but the incident has highlighted the need for robust technical infrastructure and transparent standards. As AI continues to advance, its role in education and professional licensing will likely grow—but so will the demand for accountability and fairness.
Actionable Takeaways for Test-Takers and Institutions
- Stay informed: Keep up with updates from licensing bodies about exam formats and technology changes.
- Prepare for technical issues: Practice using the exam platform ahead of time and have a backup plan in case of glitches.
- Advocate for transparency: Encourage institutions to clearly communicate how AI and other technologies are used in assessments.
- Demand oversight: Support policies that require expert review of AI-generated content in high-stakes exams.
Meta Description
The California bar exam faced controversy after the State Bar admitted to using AI-generated questions and technical issues disrupted the test. Learn what happened, expert insights, and what it means for the future of legal exams.
FAQ
Q: Why did the State Bar of California use AI to develop bar exam questions?
A: The State Bar used AI to help generate some multiple-choice questions, aiming to streamline the test development process. However, all questions were reviewed by experts before being included in the exam.
Q: What technical issues affected the February bar exam?
A: Test-takers reported platform crashes, screen lags, error messages, and difficulties saving or submitting their answers, which disrupted the exam experience.
Q: How are authorities responding to the exam problems?
A: The State Bar has recommended score adjustments and is working with the California Supreme Court to address the impact on affected test-takers.
Q: Is AI commonly used in legal exams?
A: AI is not yet widely used in legal exams, and this incident has sparked debate about its role and the need for careful oversight in test development.
Q: What should future test-takers expect?
A: While AI may continue to play a role in exam development, experts stress the importance of human oversight and robust technical support to ensure fairness and reliability.
Summary: Key Points
- The State Bar of California used AI to help develop some bar exam questions for the first time.
- Technical failures disrupted the February 2025 exam, leading to widespread complaints.
- Experts emphasize the need for transparency and human oversight when using AI in high-stakes testing.
- The State Bar is recommending score adjustments to address the impact of technical issues.
- The incident highlights both the opportunities and challenges of integrating AI into professional licensing exams.