News Archive
When the 鈥淪tars鈥� Don鈥檛 Align: Study Finds Top Reviews, Not Average Ratings, Sway Consumer Decision-Making
By Elizabeth L. Brown
TAMPA (April 7, 2022) 鈥� When it comes to online shopping habits, the collective wisdom dictates that consumers gravitate toward the highest-rated products. The difference between a 4-star average rating and a 4.5-star average rating could play a huge role when buyers are deciding to hit the 鈥淎dd to Cart鈥� button.
But a recently accepted research paper from a USF Muma College of Business researcher shows that the half-star chasm may not be all that important.
It turns out top reviews carry more sway in a customer鈥檚 final buying decisions when they are comparing products. The research debunks a widely held notion that serious online consumers buy products with a higher rating.
鈥淚t鈥檚 surprising because as a researcher, a business, or a consumer, we typically believe that when we go to Amazon, the most important piece of information is the average rating,鈥� said Dezhi (Denny) Yin, an associate professor in the School of Information Systems and Management in the Muma College of Business, who co-authored the study.
Yin said since the starred average rating is an aggregate of hundreds, sometimes thousands, of online reviews, it is the most comprehensive window into a product鈥檚 quality.
鈥淎nd what we found was that when they read some reviews, just a few reviews can overturn the impact of average ratings,鈥� he said.
Using a clever 鈥渢rade-off鈥� design, the research team conducted three studies to disentangle the effects of online ratings and top reviews on consumer decision-making.
The first study was based on real-world daily data of 538 apps ranked in the top 100 from Apple鈥檚 App Store for two months. The apps covered 21 categories, such as games, business, finance, and news.
In the two other experiments, undergraduate students were asked to make a purchase decision between two digital camera options whose 鈥渟tars鈥� from average ratings and top reviews did not align with each other. The studies not only provided converging evidence for the swaying effect of top reviews but also pointed to a possible source of this effect.
Review Details Matter
鈥淚t鈥檚 the text of the top reviews that made a difference. This swaying effect only happened for the text reviews. Without text, people are not swayed. It鈥檚 the concrete details that are driving this impact,鈥� Yin said.
Yin explained that the research is not saying that average ratings don鈥檛 matter. If a product has a low average rating, consumers will not consider the product, much less read the product reviews.
But in the cases where buyers are comparing different products and reading their reviews, a few top reviews can easily sway their purchase decisions, he said, adding that the study findings are not limited to app or product reviews.
The Ratings Game
What are the takeaways for online retailers?
Yin recommends retailers spend less effort on writing or soliciting fake reviews to try to bump up their average star rating.
鈥淏usinesses should not spend a lot of time gaming the rating system. That effort is actually not very meaningful or effective, based on our findings,鈥� Yin said. 鈥淥ur findings suggest that as long as your average ratings were fine, what matters is the top reviews.鈥�
In addition, retailers would be smart to respond to any negative top reviews, because those are the reviews that most consumers are likely to read. Retailers might counter the swaying effects of such reviews by, for example, explaining that the criticism was an isolated case or that the concern has been resolved, he said.
Also, researchers also recommend online review platforms, such as Yelp and Amazon, could benefit consumers by designing a layout that spotlights individual reviews with less emphasis on average ratings.
The article titled, examined how consumers weigh a product鈥檚 average rating versus top reviews in their decision-buying process.
The paper was available online first in February in the Production and Operations Management journal, a flagship academic journal in the business field and among the list of top 24 premier business journals compiled by the University of Texas at Dallas鈥� Naveen Jindal School of Management.
Aside from Yin, the article鈥檚 co-authors include Zhanfei Lei, University of Massachusetts Amherst; Saby Mitra, University of Florida; and Han Zhang, Georgia Institute of Technology.
To read the article, go .