My AI writing assistant hallucinated a fake court case in my legal brief

I was sitting in my home office in Austin last Tuesday, using an AI tool to help draft a motion for a client, and it invented a 2021 Supreme Court ruling that never existed. The citation looked perfect until I checked Westlaw and found nothing, which would have gotten me sanctioned if I filed it. How are we supposed to trust these tools for serious work when they just make stuff up?

3 comments

3 Comments

logan20515d ago

Yeah this is just the digital version of that GPS that tried to route my buddy into a lake last year. Garbage in, garbage out, but people treat it like magic.

the_lee15d ago

Dude that's crazy, your buddy almost drove into an actual lake?

williamhill15d ago

People forget AI can't tell the difference between real and fake, just like a dog chasing every squirrel it sees.