The most prestigious law school admissions discussion board in the world.
|
 |
 
|
Law Professors Prefer AI Over Peer Answers
| cyan brunch | 06/02/26 |
| concupiscible market | 06/02/26 |
| titillating hateful hell alpha | 06/02/26 |
| cyan brunch | 06/02/26 |
| puce cruise ship | 06/02/26 |
| irradiated yellow gunner karate | 06/02/26 |
| cyan brunch | 06/02/26 |
| puce cruise ship | 06/02/26 |
| Embarrassed to the bone ceo garrison | 06/03/26 |
| flesh haunted graveyard | 06/02/26 |
| titillating hateful hell alpha | 06/02/26 |
| Embarrassed to the bone ceo garrison | 06/03/26 |
| stirring clear puppy brethren | 06/02/26 |
Poast new message in this thread
Date: June 2nd, 2026 5:12 PM Author: cyan brunch https://law.stanford.edu/wp-content/uploads/2026/06/salinas_et_al.pdf
"Professors rated LLMs far higher than their peers (average win rate = 75.33%), with models performing similarly to the best instructor. LLM responses were also rarely flagged as harmful (3.53%, vs 12.06% for professors). Preferences for LLM answers were consistent across evaluators and reflected shared professional standards." |
 |
Date: June 2nd, 2026 5:32 PM Author: concupiscible market llm's are pretty good at legal stuff. thete's gonna be a flood of litigation as normies and proles realize a $20 claude subscription can produce at least as good of results as a $200/hr shitlaw attorney who doesn't return their calls. (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911539) |
|
Date: June 2nd, 2026 5:39 PM Author: titillating hateful hell alpha (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911544) |
|
Date: June 2nd, 2026 5:40 PM Author: cyan brunch I think filing fees will largely prevent that, but I agree that AI can do a pretty good job with basic drafting tasks. It can definitely analyze typical consumer dispute documents and create a competent complaint.
IME, the public AI tools aren't very good with legal research and citations, but a lot of cases don't require much of that. They also aren't particularly good with strategy and argument judgment. But competent drafting is typically more important than either of those for the normie litigation you're talking about. |
|
Date: June 2nd, 2026 5:43 PM Author: puce cruise ship a $500 filing fee isnt going to prevent normie litigation where stakes are high enough, such as some prole homeowner vs. a house contractor over a $30k kitchen reno (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911551) |
|
Date: June 2nd, 2026 8:08 PM Author: irradiated yellow gunner karate Which LLMs? ChatGPT has been dead fucking wrong about multiple legal questions I've asked it (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911904) |
Date: June 2nd, 2026 5:17 PM Author: cyan brunch Hey, 1Ls, no need for office hours. Just ask AI. (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911521) |
|
Date: June 2nd, 2026 5:31 PM Author: puce cruise ship Law professors prefer JDs over LLMs, the study added. (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911536) |
|
Date: June 3rd, 2026 11:33 AM Author: Embarrassed to the bone ceo garrison (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49912733) |
|
Date: June 2nd, 2026 5:44 PM Author: flesh haunted graveyard What "questions" could a law professor possibly need the answer to? Should I go to Greece or Spain for my next sabbatical? (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911554) |
|
Date: June 2nd, 2026 5:49 PM Author: titillating hateful hell alpha (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911563) |
|
Date: June 3rd, 2026 11:33 AM Author: Embarrassed to the bone ceo garrison (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49912734) |
|
Date: June 2nd, 2026 8:07 PM Author: stirring clear puppy brethren This is a dumb study with a predictable result.
They're essentially taking popular 1L cases taught first year law students, and asking professors and LLMs to explain them.
Predictably, the LLMS did better because they can just summarize the casebooks from the past 40 years in the most concise way.
But let's say we a ran a study, where we compared the explanations in the study guide vs the explanations of professors, and other professors chose the study guide 75% of the time. Would that be meaningful or surprising?
I wouldn't think so... |