This is a news story, published by Science News, that relates primarily to Deborah Raji news.
For more Deborah Raji news, you can click here:
more Deborah Raji newsFor more Ai research news, you can click here:
more Ai research newsFor more news from Science News, you can click here:
more news from Science NewsOtherweb, Inc is a public benefit corporation, dedicated to improving the quality of news people consume. We are non-partisan, junk-free, and ad-free. We use artificial intelligence (AI) to remove junk from your news feed, and allow you to select the best tech news, business news, entertainment news, and much more. If you like this article about Ai research, you might also like this article about
health care AI testing. We are dedicated to bringing you the highest-quality news, junk-free and ad-free, about your favorite topics. Please come every day to read the latest health care AI models news, AI tools news, news about Ai research, and other high-quality news about any topic that interests you. We are working hard to create the best news aggregator on the web, and to put you in control of your news feed - whether you choose to read the latest news through our website, our news app, or our daily newsletter - all free!
Medicine AIScience News
•Technology
Technology
86% Informative
A review of studies evaluating health care AI models, specifically LLMs, found that only 5 percent used real patient data.
The current benchmarks are distracting, computer scientist Deborah Raji and colleagues argue.
Raji: These benchmarks are not indicative of the types of applications people are aspiring to, so the field should not obsess about them.
Right now, evaluation is very much an afterthought, says Raji .
Raji: We should be more thoughtful about the evaluations that we focus on or that we overly base our performance on.
He says hospitals should share the full list of different AI products that they make use of as part of their clinical practice.
VR Score
91
Informative language
93
Neutral language
47
Article tone
informal
Language
English
Language complexity
55
Offensive language
not offensive
Hate speech
not hateful
Attention-grabbing headline
not detected
Known propaganda techniques
not detected
Time-value
long-living
External references
3
Source diversity
3
Affiliate links
no affiliate links
