June 20, 2010
June 20, 2010
June 23, 2010
15.208.1 - 15.208.17
Assessing the Effectiveness of Using a Computer Game to Bridge a Research Agenda with a Teaching Agenda
We assess the impact of an out-of-class computer game designed to develop students’ understanding of complex tradeoffs among environmental, economic, and technological issues. By comparing the results across three different courses using survey, essay, and focus groups as instruments, we measure the game’s success in a variety of contexts and dimensions. Students increased their self-assessed knowledge about the supply chain and teamwork in the supply chain, they made connections between the environment and business practices as well as external events and the supply chain, but they did not feel that their understanding of sustainability improved. Students in an economics class experienced less increase and knowledge and confidence than did students in either an introductory policy class or a values-oriented course about built systems.
Academics who care about both teaching and research are continually seeking ways to effectively integrate the two. Those who pursue National Science Foundation (NSF) funding often wrestle with this when answering the question: What are the broader impacts of the proposed activity? NSF asserts that the broader impacts criterion speaks directly to NSF’s mission, “To promote the progress of science; to advance the national health, prosperity, and welfare; and to secure the national defense.” (NSF Act of 1950). The NSF Grant Proposal Guide suggests several ways that this criterion can be met. One of these is “by advancing discovery and understanding while promoting teaching, training, and learning”. In response, researchers typically describe the number of students involved in the research project as evidence. Another suggestion by NSF is to broaden dissemination to enhance scientific and technological understanding. Here, researchers often describe plans to present research results in formats useful to students, scholars, members of Congress, teachers, the general public, etc. In other words, it is common for researchers to point to activities that involve student education as evidence that there are broader impacts to their technical research projects.
Faced with this challenge in our own research, we are following a different approach to achieve these education-related broader impacts. We suggest that we can successfully bring our research concepts into our traditional courses without unduly modifying the established course content. To accomplish this task, we use an out-of-class, self-directed computer simulation game by which students are expected to gain introductory knowledge of the research concepts as they “play” the game. We then draw connections between what they learned from the game and what they are learning (or not) in the course. Our hope is that this experiential form of learning can serve to bridge our research and teaching goals. To determine the effectiveness of this approach, we perform several student assessments centered on the question: Can students achieve a set of learning outcomes by playing a self-directed, out-of-class computer game? The remainder of this paper explains the research and grounds the work in relevant literature, describes our approach to assessment, and reports the results of assessments conducted during academic year 2008-2009.
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2010 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015