Study also reports users lose trust in systems that give phony ratings
Online "recommender systems" are used to suggest highly rated selections for book buyers, movie renters or other consumers, but a new study by University of Minnesota computer science researchers shows for the first time that a system that lies about ratings can manipulate users opinions. Over time, however, users lose trust in unscrupulous systems.
The Minnesota research group, led by professors Joseph Konstan and John Riedl, conducted experiments with MovieLens, a member driven movie recommendation Web site, which the Minnesota team created to put their research on recommender systems into practice. The results of their latest studies will be presented at the CHI 2003 Conference on Human Factors in Computing Systems, April 5-10, 2003, in Fort Lauderdale, Fla. The work is supported by the National Science Foundation, the independent federal agency that supports basic research in all fields of science and engineering.
The results suggest that "shills," who flood recommender systems with artificially high (or low) ratings, can have an impact and that recommender systems will take longer than previously expected to self-correct. The idea behind self-correction is that misled users will come back and give the item in question a more accurate rating.
"This study isnt about defending against shill attacks, but about trust in the system," Konstan said. "Our results show that individual shilling will take longer to correct, but the larger impact is the loss of trust in the system." In the Minnesota study, users were sensitive to the quality of the predictions and expressed dissatisfaction when the system gave inaccurate ratings.
Taken together, the experiments provide several tips for the designers of interfaces to recommender systems. Interfaces should allow users to concentrate on rating while ignoring predictions. Finer-grained rating scales are preferred over simple "thumbs up, thumbs down" scales, but are not essential to good predictions. Finally, because users are sensitive to manipulation and inaccurate predictions, to keep customers happy, no recommender system at all is better than a bad recommender system.
Many online shopping sites use recommender systems to help consumers cope with information overload and steer consumers toward products that might interest them. Recommender systems based on "collaborative filtering" generate recommendations based on a users selections or ratings and the ratings of other users with similar tastes.
The CHI 2003 paper reports the results of three experiments that attempted to shed light on questions such as "Can the system make a user rate a bad movie good?" "Do users notice when predictions are manipulated?" "Are users consistent in their ratings?" and "How do different rating scales affect users ratings?"
"To our knowledge, no one has studied how recommendations affect users opinions," Konstan said. "We thought it was a socially important question because many of these systems are used in commercial applications. We found that if the system lies you can gain some influence in the short term, but you lose trust in the long term. This is a lot like trust between humans."
In the first experiment, users re-rated movies while presented with some "predictions" that were different from the users prior rating of the movie. In the second experiment, users rated movies they hadnt rated before. Some users saw "predictions" that were skewed higher or lower, while a control group saw only the systems accurate predictions. The final experiment had users re-rate movies using three different rating scales and asked users their opinions of the different scales. In the re-rating experiment, users were generally consistent, but they did tend to change their rating in the direction of the systems skewed "prediction." In fact, users could even be influenced to change a rating from negative to positive or vice versa. When users rated previously unrated movies, they tended to rate toward the systems prediction, whether it was skewed or not.
Konstan also noted that, while this study used movie ratings, recommender systems have much wider application. Such systems can also be used for identifying highly rated research papers from a given field or for knowledge management in large enterprises. New employees, for example, can bring themselves up to speed by focusing on highly rated news items or background materials.
More focus and comfort at telephone workstations
20.02.2020 | Fraunhofer-Institut für Digitale Medientechnologie IDMT
New cruise ship “Mein Schiff 1” features Fraunhofer 3D sound on board
05.09.2018 | Fraunhofer-Institut für Digitale Medientechnologie IDMT
Researchers at the University of Bayreuth have discovered an unusual material: When cooled down to two degrees Celsius, its crystal structure and electronic properties change abruptly and significantly. In this new state, the distances between iron atoms can be tailored with the help of light beams. This opens up intriguing possibilities for application in the field of information technology. The scientists have presented their discovery in the journal "Angewandte Chemie - International Edition". The new findings are the result of close cooperation with partnering facilities in Augsburg, Dresden, Hamburg, and Moscow.
The material is an unusual form of iron oxide with the formula Fe₅O₆. The researchers produced it at a pressure of 15 gigapascals in a high-pressure laboratory...
Study by Mainz physicists indicates that the next generation of neutrino experiments may well find the answer to one of the most pressing issues in neutrino physics
Among the most exciting challenges in modern physics is the identification of the neutrino mass ordering. Physicists from the Cluster of Excellence PRISMA+ at...
Fraunhofer researchers are investigating the potential of microimplants to stimulate nerve cells and treat chronic conditions like asthma, diabetes, or Parkinson’s disease. Find out what makes this form of treatment so appealing and which challenges the researchers still have to master.
A study by the Robert Koch Institute has found that one in four women will suffer from weak bladders at some point in their lives. Treatments of this condition...
The operational speed of semiconductors in various electronic and optoelectronic devices is limited to several gigahertz (a billion oscillations per second). This constrains the upper limit of the operational speed of computing. Now researchers from the Max Planck Institute for the Structure and Dynamics of Matter in Hamburg, Germany, and the Indian Institute of Technology in Bombay have explained how these processes can be sped up through the use of light waves and defected solid materials.
Light waves perform several hundred trillion oscillations per second. Hence, it is natural to envision employing light oscillations to drive the electronic...
Most natural and artificial surfaces are rough: metals and even glasses that appear smooth to the naked eye can look like jagged mountain ranges under the microscope. There is currently no uniform theory about the origin of this roughness despite it being observed on all scales, from the atomic to the tectonic. Scientists suspect that the rough surface is formed by irreversible plastic deformation that occurs in many processes of mechanical machining of components such as milling.
Prof. Dr. Lars Pastewka from the Simulation group at the Department of Microsystems Engineering at the University of Freiburg and his team have simulated such...
12.02.2020 | Event News
16.01.2020 | Event News
15.01.2020 | Event News
25.02.2020 | Power and Electrical Engineering
25.02.2020 | Earth Sciences
25.02.2020 | Life Sciences