AI tools might be hallucinating less, but they're still spitting out inaccurate answers cloaked in polished, hyper-confident language....
Driving the news: New research suggests AI note-taking tools (often called AI scribes) can help in medical settings, but only in tandem with professional reviewers.
- A Yale School of Medicine study this month found that first-year medical students who revised their own clinical notes with AI-generated drafts generally maintained note quality.
- But the AI notes themselves often omitted important details, including symptom duration.
- Two-thirds of students said the notes were "helpful as a first draft," but 21% said the note taker "may reduce my ability to learn how to write a good note."
Looking at the papers submitted by my students this last semester, I saw a lot of this: very polished prose, drawing confidential conclusions with weak or no supporting evidence. And of course, hallucinate sources.
I use SuperGrok for some tasks in the shop or for astronomy, but I have learned mostly to use it as a really good search engine. It makes enough mistakes that I never completely trust it
No comments:
Post a Comment