Serious game

Draft

<pageby nominor="false" comments="false"/>

Introduction

Serious games induce some kind of affective or motor learning (understood in very broad sense) at any level. Put more simply: serious games are used for more than entertainment. (Susi et al. 2007, Breuer & Bente, 2010).

Serious games have a long history. A good example are military games. Today (since the late nineties), "serious game" most often related to a kind of educational computer game or a kind of educational computer simulation.

Abt (1975:9) is considered to be the first author to define serious game: "We are concerned with serious games in the sense that these games have an explicit and carefully thought-out educational purpose and are not intended to be played primarily for amusement." According to Susi et al. (2007) serious games are games that “engage the user and contribute to the achievement of predefined objectives”. In other words, serious games are also being used for other purposes than education. According to Breuer & Bente (2010), “the term 'serious game' as it applies to digital games was coined by Ben Sawyer in his 2003 paper on the potential of using digital games for policy making (Sawyer 2003).”

We suggest the following technical definition for serious computer games: A serious computer game is any kind of interactive application - for example a computer simulation or a microworld - that is designed and implemented according to gameplay principles. Often, a serious computer game make use of game technology that has been developped for recrational purposes, but it must not. Finally, a non-serious game could be used for serious purposes, e.g. a board game may be used for teambuilding or to learn strategic thinking.

The main purpose of serious games is education and training. Within education, there are many different subtypes, e.g. drill and practice games on one end and so-called "epistemic games" that help players learn to think like professionals on the other.

Other areas of serious gaming use include advertizing, political and religious propaganda, health (helping people in various ways with health issues), military, etc.

Aldrich (2009b) presented a diagram that defines serious games as a games genre that can include educational simulations.

File:Virtual-worlds-Aldrich-2009

This schema was was originally published in Innovate (http://www.innovateonline.info/) as: Aldrich, C. 2009. Virtual worlds, simulations, and games for education: A unifying view. Innovate 5 (5). http://www.innovateonline.info/index.php?view=article&id=727 (accessed oct. 23 2012). The image is reprinted here with permission of the publisher, The Fischler School of Education and Human Services at Nova Southeastern University.

Breuer and Bente (2010) created a Venn diagram that we reproduced in slightly modified form and that identifes how serious games fit into the general "entertain education" area and how it relates to technology-enhanced learning (called e-learning in the original):

Serious games in the Landscape. Modified figure from Breuer and Bente (2010)

Entertainment education simply refers to the ida to make learning more enjoyable, e.g. by adding game design elements, though gamification or other similar means. Game-based learning refers to all sorts of games made for educational purposes. Digital game-based learning (DGBL) includes games that include learning as the main or sole purpose, both typical learning games of the 80's as well as large subset of modern serious games. The diagram shows that serious games may include other purposes than education. Edutainment can be seen as a subset of DGBL (as in the original figure), however we also left the possibility that edutainment can just refer to a kind of non-serious game (e.g. a title that may not harm your children)

See also:

• gamification
• gameplay and playability
• microworld
• simulation
• Computer game

Learning effects and assessment

Hopes

“Can games be used to support meaningful learning? Most likely the answer is yes, conditional on more research being conducted in this area. In general, we believe that (a) learning is at its best when it is active, goal-oriented, contextual-ized, and interesting (e.g., Bransford, Brown, & Cocking, 2000; Bruner, 1961; Quinn, 2005; Vygotsky, 1978); and (b) learning environments should thus be interactive, provide ongoing feedback, grab and sustain attention, and have appropriate and adaptive levels of challenge— i.e., the features of good games (e.g., Prensky, 2001; Salen & Zimmerman, 2004).” (Shute et al. 2010: 137)

The Summit on Educational Games, page 18 identifies the following features of optimal learning environments and note that gameplayers implemented many of these features in gameplay:

• Clear learning goals
• Broad experiences and practice opportunities that continue to challenge the learner and reinforce expertise
• Continuous monitoring of progress, and use of this information to diagnose performance and adjust instruction to learner level of mastery
• Encouragement of inquiry and questions, and response with answers that are appropriate to the learner and context
• Contextual Bridging: Games and simulations can close the gap between what is learned and its use.

A major puzzle in terms of motivation concerns hard fun (Papert, 1998). Many games are difficult and achieving a certain level relies a longer and maybe diffcult process. Therefore one may ask the question, why some some people enjoy the challenge of a game but dislike challenges in a school setting. Although this does not apply to the whole population - the promotors of serious gaming seem to forget that most people don't play and proable don't like to play video games and that many leaners actually do enjoy leaning - one can ask what differs a learning situation in game from the one in a typical school setting.

Firstly, Breuer and Bente (2010) point out that in game there are three levels of human-computer interaction: “

1. On a micro-level of individual inputs and outputs (e.g. you push a button and your character moves)
2. On a narrative level (i.e. you interact with game elements such as non-player characters to progress through the game and unfold its story)
3. On a meta-level of setting and manipulating the game's rules (this includes choosing a difficulty levels as well as cheating or creating your own game content via editors)”

This means, that a learner can experience a feeling of self-efficacy, i.e. more easily experience their own actions to be effective in the virtual game world. More generally, games seem to induce states of flow, i.e. situations where learners have clear goals and receive immediate feedback, the challenge is adapted to the skill level, feel to be in control, are focused on the task, etc.

The Summit on Educational Games report also identifies the kinds of knowledge and skills that might be taught effectively with games and simulation. The list includes knowledge and skills that are hard to teach and train in other ways.

• Higher order skills such as strategic thinking, resource management mastery, interaction with systems, multi-tasking and decision making within complex situations and changing scenarios, learning to compromise and to make trade-offs, manage complex relationships, exercise leadership, collaboration and team building
• Practial Skills Training in a safe environment, such as operating complex machinery, laboratory work, marketing techniques
• High Performance Situations
• Rarely used skills
• Developing expertise
• Team building

Research

.... to do ....

How about learning from playing "not serious" games.

Breuer (2011:241) identified several types of studies that investigated the influence of playing digital games on perception and lower level cognitive processing. “Previous research has, e.g., shown that digital games can improve visual selective attention (Green and Bavelier, 2000), mental rotation skills (Greenfeld et al., 1994), spatial perception (Subrahmanyam, 1994) or eye-hand coordination (Griffith et al., 1983).” He also notes that few research exists with respect to higher-order cognition and concludes: “Given the complexity of tasks present in many current computer and video games the question arises whether digital games can also affect higher order information processing such as the formation and alteration of cognitive schemata.”

Measuring learning

Shute et al. (2010), in order to respect learning though games, suggest to “focus on propose using ECD (Evidence-centered design), stealth assessment, and automated data collection and analysis tools to not only collect valid evidence of students’ competency states in game environments, but to also reduce teachers’ workload in relation to managing the students’ work (or “play”) products.” (Shute et al. 2010: 158).

Gunter, Kenny & Vick, (2008) describe the RETAIN model developed by Shelly, Gunter et al. and that is based on several components:

• Keller's ARCS theory
• Gagnés nine events of instruction in relation with Learning_level#Blooms_taxonomy Bloom's learning taxonomy
• Gameplay and playability principles tied to intellectual engagement with learning
• Piaget’s concept of adaptation (including assimilation and accommodation) and schemes, i.e. some kind of constructivism

The RETAIN model defines five criteria for which 0-3 levels are defined:

1. Relevance: “In addition to presenting learning materials in a way that is relevant to learners, their needs, and their learning styles, instructional units should be relevant to one another.” (Gunter et al., 2008) and according to Sweller's germaine load principle “the more closely the materials are related to the focus of what is to be learned, and the more relevant the topics are to the learner the greater for learning is to take place.” (Gunter et al., 2008)
2. Embedding: “how closely the academic content is coupled with the fantasy/story content” (Gunter et al., 2008). I.e. typical game elements like structure, storylines, player experience, dramatic structure, fictive elements must be directly related to academic knowledge. ()
3. Transfer: “ability to teach player–learners how to transfer knowledge from one situation to another requires the answers to several questions.” (Gunter et al., 2008). This implies that transfer firstly has to happen within games using new and different situations. Transfer is related to Bloms higher levels and Gagné's steps three and nine.
4. Adaptation: “Assimilation relates to a process in which learners interpret events in terms of what they already know. Accommodation relates to transfer and refers to learners being forced to change or create new knowledge to make sense of something that doe not fit their existing ideas or understandings” (Gunter et al., 2008)
5. Immersion: “[...] can be measured hierarchically from a simple interaction/reaction to being fully engaged to an intellectual investing in the context of the game (learning situation)” (Gunter et al., 2008). This implies that immersion goes beyond simple feeling of being there, i.e. the player should be intellectually engaged.
6. Naturalisation: “[...] correlates to the concept of automaticity or spontaneous knowledge, in which a student uses the learned information habitually and consistently, monitors it, but does not have to devote significant mental resources thinking about it.” (Gunter et al., 2008). This concept also could be related to procedure learning (Anderson).

Summary table of the RETAIN evaluation rubric (for details, please consult the original). Level 3 includes levels 1 and 2, and level 2 includes level 1

caption

	Level 0	Level 1	Level 2	Level 3
Relevance	little stimulus for learning	limited educational focus, some irrelevant content	Learning objectives are defined, interest is created	game is relevant to learners, and challenges or adequate for learning
Embedding	learning content disrupts play	Learning is exogeneous to fantasy context	includes intellectual challenge and problems	content is endogenous to fantasy and fully involves learner
Transfer	No levels of challenge mapped to objectives	Levels of challenge are too similar, some useful content	Easy progress through levels through active problem solving. Higher level knowledge should be transferable	Authentic real life situations and after action reviews
Adaptation	Fails to engage in interactive, unstructured information	Builds upon existing cognitive structures, engages in cognitive conflict	Learners are encouraged to go beyond given information. Old schemas are identified and adapted to new situations	Learning becomes an active process that integrates prior knowledge
Immersion	No formative feedback, little active participation	Elements of play are not in sync with learning objectives, players do not feel fully interactive	learners are involved cognitively, physically and emotionally	Favors belief creation and includes opportunities for reciprocal action
Naturalization	Little opportunity for mastery of facts and skills	Replay is encouraged to improve speed of processing	Encourages synthesis of elements and judgments	Learners become efficient content users and spontaneously use acquired knowledge

Game design

Gunter et al. (2006:104) define the following most important elements of serious game design:

• Scenario exposition
• Problem Setup
• Offer Challenge/Choice
• Provide Direction
• Elicit Action/Decision
• Discernable Outcomes
• Success/Failure Screens

With respect to Gagne's nine events of instruction, they consider that "stimulating recall" and more importantly "retention and transfer" may be missing from common game elements. This led the authors to formulate the RETAIN model we alread introduced above.

History

Serious computer games go back to the 1970's (Abt, 1970), and mainly appeared under names like "educational game", "business game", "gaming and simuluation", "simulation", "edutainment", political games. However, there may be some subtle differences with respect to modern main-stream serious games, for example:

• The "fun" aspect usually was less developed in simulation games
• Older serious games did less often use so-called gaming engines
• Educational games did often just implement a rewards system and were probably not as engaging as real video games
• Edutainment refers to games that (maybe) would develop cognitive skills with younger children, mainly commercial CDs
• Serious games most often play in real world settings and the target audience is rather adults as opposed to smaller children in edutainment or older educational games.

Recently, so-called gamification gained attention in some circles. "Gamification" mainly uses simple reward systems that are supposed to engage users in activities. It's inspired by "boy scout" badges and actually implements badging systems.

Genres

Serious games are not necessarily labeled as such. Many synomyes are used, e.g. immersive Learning Simulations (ILS) or game-based learning software. In addition, some types of simulations, construction environments like microworlds, etc. that do have some kind of "fun" aspect now are also being sold as serious games...

A natural list

Below is a provisional list of genres. Some can overlap, i.e. a game can be a kind of several genres.

• Advertizing games: “is the practice of using video games to advertise a product, organization or viewpoint.” (Advergaming, Wikipedia)

• Construction games: include several subgenres
  • Building games (e.g. roads, bridges, buildings, ...) where players acquire some underlying principles and/or skills.
  • Simulation games like SimCity where players could develop more abstract knowledge like planning or understanding a system.

• Edutainment: include games that may teach something to children or at least not harm them ... Usually commercial CD ROMS.

• Health games: include a broad range of games
  • Exergames: help people exercising and often includes technology that tracks body movements, body reactions, or use of mechanical devices. In addtion, such games often use input devices like a wii fit board or the Kinect.
  • Assessment games
  • Therapeutic games
  • Prevention games

• News games: apply journalistic principles to the creation of a game (Newsgame, Wikipedia). Its purpose is often to sensitize people about a recent situation.

• Games for change, games for good etc.

• Simulation

• Games for science, e.g. citizen science games

It is difficult to draw a clear border between serious games and simulations and between serious games and edutainment. The difference between a serious games and a simulation is that serious games rely on key elements of computer gaming, i.e must be based on good gameplay and playability. The difference between serious games and other gaming genres like edutainment may be that the former has some built-in serious purpose, whereas the latter becomes serious when the user decides to assign such a purpose to it.

Taxonomies

“There is no uniform pedagogy within serious or educational games; earlier games tended to be based on a behaviourist model. later games try and incorporate experiential, situated and socio-cultural pedagogical models. the learning outcome is dependent upon an appropriate pedagogy and the underlying game mechanics and how the content is integrated into the game so the learning is intrinsic to play.” (PDF Ulicsak and Wright, 2010).

Brannigan (Caspian learning

Chris Brannigan of Caspian learning in some slides and in blog postings, retrieved 16:33, 10 October 2012 (CEST) identifies the following types, most of which are a kind of simulation:

• Egocentric Sims: Player plays an individual character and views the action as through the eyes of this individual character.
• Branching Story Sims: Engage the user in an unfolding sequence of animated scenes within a story or event. The user is able to influence and even determine the flow of the story by making choices and decisions at different points.
• Real Time Strategy Sims: A player is given control over a range of resources and units to manipulate and deploy within an evolving scenario. This is a variant of episodic turn-based sims.
• Exocentric Sims: Player sees the world in a perspective from above. Typically she/he could control persona and objects in the scenario.
• Episodic Sims: An episode of action and events will occur and then the player is given their ‘turn’ to make a response. Example: Civilization (game) or business simulations.
• Construction and resource Management: A player must build, expand or manage an entity or project with limited resources. As opposed to to turn-based or real time strategy simulations, the emphasis is on building and managing. E.g. SimWorld
• Virtual Worlds: Such multi-user environments allow to control and dvelop an avatar. The player has relative freedom to move and to act. Exemple: Second life or games embedded in second life.
• Device-based Sims: provide the player with realistic operating control over various kinds of devices and vehicles. E.g. an airplane, a machine to operate, a car.

Branningan's taxonomy focuses on kinds of game play and human-computer interfaces.

Sawyer and Smith

Ben Sawyer and Peter Smith, in their 2008 Serious Games Taxonomy (broken link), used two dimensions:

1. Content: Games for Health, Advergames, Games for Training, Games for Education, Games for Science and Research, Production, Games as Work
2. Sector: Government & NGO, Defense, Healthcare, Marketing & Communications, Education, Corporate, Industry

Crosstabulated, this lead to the following table:

Sawyer & Smith Serious games taxonomy 2008: Source: Understanding "Serious" Games

Breuer and Bente

Breuer and Bente (2010) suggest nine criteria for classifying serious games and the authors suggest that it “is flexible and open for additions and changes. It can be used not only by game designers to advertise their products, but also by researchers to describe and compare games and by educators and learners who use them to express their view of and experience with the game.”

1. Platform
2. Subject Matter
3. Learning Goals
4. Learning Principles, e.g. rote memorization, exploration, observational learning, trial and error, conditioning
5. Target audience
6. Interaction mode(s), e.g. multiplayer, Co-Tutoring, single player, massively multiplayer, tutoring agents
7. Application area, e.g. academic education, private use, professional training
8. Controls/Interfaces, e.g. gamepad controlled, mouse & keyboard, Wii balance board
9. Common gaming labels, e.g. puzzle, action, role-play, simulation, card game, quiz

Examples

(by no means complete so far, there are many kinds)

History

• 1066 (by Channel4)

Political sensibilization, education and propaganda

Many of these games are playable through a web browser. Some of these may require a plugin, e.g. Flash or a more exotic format like Unity

• Amnesty the Game “Using your wits, drive and passion you have the opportunity to save six prisoners condemned to death, help spread the message of justice and human rights, and support Amnesty International’s fight against Capital Punishment!”
  • Wikipedia entry

• Food Force, Win/Mac, free download
  • FoodForce2, a multiplatform offspring/clone that is open source.
  • Wikipedia entry

• Darfur is Dying, Internet, sponsored by mtvU

Citizen Cyberscience games

• FoldIt

Links

Overviews

• Serious game (Wikipedia)

• Serious Games Taxonomy by Ben Sawyer: Digitalmill, Inc. & Serious Games Initiative and Peter Smith: University of Central Florida, RETRO Lab.

Slides

• Understanding "Serious" Games by Jonathan Frye
• Serious Games Taxonomy, by Ben Sawyer and Peter Smith. 2008.

Reports

• Summit on Educational Games, Harnessing the power of video games for learning. Web site includes a Fact Sheet, PPT, and Full report, Federation of American Scientists, 2005. Still good reading.

Indexes of serious games

• Serious game (Wikipedia), includes a longer list at the end of the article

• Jeux pédagogiques List of entries in french made by our students

People and organizations

• SeriousGames.org: “The Serious Games Initiative is focused on uses for games in exploring management and leadership challenges facing the public sector. Part of its overall charter is to help forge productive links between the electronic game industry and projects involving the use of games in education, training, health, and public policy. The Serious Games Initiative was founded at the Woodrow Wilson Center for International Scholars in Washington, D.C.”, retrieved 11:40, 5 October 2012 (CEST). At this date, the website was empty (only a home page)...

• Games for Health “Founded in 2004, the Games for Health Project supports community, knowledge and business development efforts to use cutting-edge games and game technologies to improve health and health care. The Pioneer Portfolio of the Robert Wood Johnson Foundation is the lead conference sponsor and a major supporter of the Games for Health Project.”, retrieved 11:40, 5 October 2012 (CEST)

• HealthGamesResearch.org: “Health Games Research is a national program that provides scientific leadership and resources to advance the research, design, and effectiveness of digital games and game technologies that promote health. It is funded by the Robert Wood Johnson Foundation’s Pioneer Portfolio and headquartered at the University of California, Santa Barbara.”, , retrieved 11:40, 5 October 2012 (CEST)

• Epistemic games group
  • All publications (many !)

• Twitchspeed (Marc Prensky's website)

Journals

• Eludamos - Journal for Computer Game culture (Open access)

conferences and proceedings

• SGDA 2012 (list of contributions, but (Access restricted)
  • Minhua Ma, Manuel Fradinho, Jannicke Baalsrud Hauge, Heiko Duin, Klaus-Dieter Thoben (Eds.): Serious Games Development and Applications - Third International Conference, SGDA 2012, Bremen, Germany, September 26-29, 2012. Proceedings. Lecture Notes in Computer Science 7528 Springer 2012, ISBN 978-3-642-33686-7

• ICEC 2012. International conference on entertainment computing. (no proceedings so far).

• Serious Games and Edutainment Applications 2011,
  • Minhua Ma, Andreas Oikonomou, Lakhmi C. Jain (Eds.): Serious Games and Edutainment Applications. Springer 2011, ISBN 978-1-447-12160-2

Resource sites and pages

• Appendix C. Bibliography of the Serious Games: Games That Educate, Train, and Inform book by D. Michael and S. Chen, 2005.ISBN 1592006221

• Research related to Serious Games by Peter HAstings, DePaul University. (some AI-related articles of interest, last updated 2008 as of 17:35, 8 October 2012 (CEST))

• Ideas from games by Mario Valle (last updated oct. 2004)

• GALA (EU Network of Excellence in Serious Games) - Assessment in serious/educational games, Mendely Group, last updated March 2012 as of oct. 2012.

• Le blog SeriousGame.be (in french)

Informal literature

• Serious Games: Improving Public Policy Through Game-Based Learning and Simulation, Wilson Center (undated)

Bibliography

• Annetta, Len; Marshall R. Murray, Shelby Gull Laird, Stephanie C. Bohr, and John C. Park (2006). Serious Games: Incorporating Video Games in the Classroom, EDUCAUSE Quarterly, HTML

• Abt, C. (1970). Serious Games. New York: The Viking Press.

• Aldrich, C., (2009b). Virtual worlds, simulations, and games for education: A unifying view. innovate: Journal of Online education, 5(5). PDF (Open access)

• Aldrich, Clark (2009). The Complete Guide to Simulations and Serious Games. Pfeiffer. pp. 576. ISBN 0-470-46273-6.

• Alexander, A.L. Brunyé, T., Sidman, J. & Weil, S.A., 2005. From Gaming to training: A review of Studies on Fidelity, immersion, Presence, and buy-in and their effects on transfer in PC-based Simulations and Games. [http:/www.darwars.bbn.com/downloads/DARWARS%20Paper%2012205.pdf PDF]

• Alvarez J., Rampnoux O., (2007). Serious Game: Just a question of posture?, Artificial & Ambient Intelligence, AISB'07, Newcastle, UK, April 2007, 420-423

• Alvarez, J. and Michaud, L. (2008) Serious games. Advergaming, edugaming, training and more. Montpellier, France: IDATE.

• Apperley, T. H. (2006) Toward a critical approach to video game genres. Simulation & Gaming, 37 (1), p.6-23.

• Baker, E.L. & Delacruz, G.C., 2008. What Do We Know About Assessment in Games? American educational research Association. PDF

• Baranowski T, Buday R, Thompson DI, Baranowski J. (2008). Playing for real: video games and stories for health-related behavior change. Am J Prev Med. 34(1):74-82.

• Bente, G. and Breuer, J. (2009) Making the implicit explicit. Embedded measurement in serious games. In U. Ritterfeld, M. Cody & P. Vorderer (eds.) Serious Games: Mechanisms and Effects. Routledge.

• Bergeron Bryan (2006). Developing Serious Games Game Development Series, Charles River Media.

• Binsubaih, A., Maddock, S. & Romano, D., 2009. Serious Games for the Police: Opportunities and Challenges.

• Blunt, R. (2009) Do serious games work? Results from three studies, eLearn Magazine, December 1

• Breuer, Johannes and Gary Bente, Why so serious? On the Relation of Serious Games and Learning, Eludamos. Journal for Computer Game Culture. 2010; 4 (1), p. 7-24 HTML (Open access).

• Breuer, Johannes, (2011). (In)formative play: the effects of digital games on creativity and problem-solving skills. FDG 2011: 241-243

• Breuer, Johannes; Nick Dyer-Witheford and Greig de Peuter. (2012). Games of empire: Global capitalism and video games. New Media & Society 14(3): 541-543.

• Carr, D., Oliver, M. & Burn, A., 2010. Learning, Teaching And Ambiguity In Virtual Worlds. In Peachey, A, Gillen, J, Livingstone, D, Smith-robbins, S. (eds). researching learning in virtual worlds, Springer.

• Charsky, D. and Mims, C. (2008) Integrating Commercial Off-the-Shelf Video Games into School Curriculums. TechTrends: Linking Research and Practive to Improve Learning, Vol. 52 (5), p. 38-44.

• Chatfield, T., 2010. Fun Inc.: Why Games are the 21st Century’s Most Serious business, virgin books.

• Chin, J., Dukes, r. & Gamson, w., 2009. Assessment in Simulation and Gaming: A review of the last 40 Years. Simulation & Gaming, 40(4), 553-568.

• DAES, T.D.O.A.E.&.S.(2008). MoD Strategy for Simulation (including Modelling and Synthetic environments), Ministry of Defence.

• de FreItas, S., 2006. Learning In Immersive Worlds: A review of game based learning, JISC. HTML

• de Freitas, S. & Oliver, M., 2006. How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? Computers & education, 46(3), 249-264.

• Derryberry, A., 2007. Serious Games: online games for learning - adobe whitepaper, HTML (broken link)

• Egenfeldt-Nielsen, S., 2007. Third Generation Educational Use Of Computer Games. Journal of educational Multimedia and Hypermedia, 16(3), 263.

• Egenfeldt-Nielsen, S., Smith, J.H. & Tosca, S.P., 2008. Understanding Video Games: The Essential Introduction, Routledge.

• Felicia, P., 2009. Digital Games In Schools: A Handbook For Teachers, European Schoolnet, Eun Partnership AISBL, PDF

• Gee, J. & Shaffer, D., 2010. Looking where the light is bad: video games and the future of assessment, Madison: university of wisconsin-Madison. PDF

• Gee, J., 2008. Getting over the slump: Innovation strategies to promote children's learning, Joan Ganz Cooney Center.

• Gee, J.P., 2005. What would a state of the art instructional video game look like. innovate Journal of online education, 1(6).

• Green, P.M., and Bavelier, D. 2000. Action video game modifies visual selective attention. Nature 6939, 423, 534-537.

• Greenfield, P. M., Brannon, C., and Lohr, D. 1994. Two-Dimensional Representation of Movement Through Three-Dimensional Space: The Role of Video Game Expertise. Journal of Applied Developmental Psychology 15, 1, 87-103.

• Griffith, J. L., Voloschin, P., Gibb, G., and Bailey, J. R. 1983. Differences in Eye-Hand Motor Coordination of Video-Game Users and Non-Users. Perceptual and Motor Skills 57, 1, 155-158.

• Griffitths, M. (2003) The therapeutic use of videogames in childhood and adolescence. Clinical Child Psychology & Psychiatry, Vol. 8 (4), p.547-554.

• Groff, J., Howells, C. and Cranmer, S., 2010. The Impact of Games in the Classroom: Evidence from schools in Scotland. Bristol: Futurelab.

• Gunter, G. A., Kenny, R. F., and Vick, E. H. (2006). A case for a formal design paradigm for serious games, The Journal of the International Digital Media and Arts Association, vol. 3, no. 1, pp. 93-105. PDF Preprint

• Gunter, G.A., Kenny, R.F. & Vick, E.H., 2008. Taking educational games seriously: using the RETAIN model to design endogenous fantasy into standalone educational games. Educational Technology Research And Development, 56 (5-6), 511-537. HTML (Access restricted) - PDF (open)

• Hanghøj, T., & Magnussen, R., 2010. The role of the teacher in facilitating educational games: Outlining a game pedagogy. in Designs for learning 2010. Sweden. PDF (broken link)

• Harteveld, C., Guimaraes, R., Mayer, I. & Bidarra, R., 2007. Balancing Pedagogy, Game and Reality Components Within A Unique Serious Game For Training Levee Inspection in technologies for e-learning and Digital entertainment. In Hui K., Pan Z., Chung r.C. & Jin X. (eds), Second international Conference, edutainment 2007, Hong Kong, China, June 2007, Springer, pp. 128-139.

• Hoffman, E., 2006. Games for Health 2006: Pulse!! First-Person Healthcare System Simulation. Serious Games Source. HTML (broken link)

• Hutton, E., and Sundar, S. S. 2008. Can Video Games Enhance Creativity? An Experimental Investigation of Emotion Generated by Dance Dance Revolution. Paper presented at the 58th Annual Meeting of the International Communication Association

• Isler, V. & Brom, C., 2008. Designing an educational game: Case study of 'Europe 2045'. Transactions on edutainment I. Springer Berlin / Heidelberg, 1-16.

• JISC, 2007. Game-based learning : JiSC. HTML

• Jenkins, H., Camper, B., Chisholm, A., Grigsby, N., Klopfer, E., Osterweil, S., et al. (2009) From Serious Games to Serious Gaming. In Ritterfeld, U., Cody, M. and Vorderer, P. (eds.) Serious Games: Mechanisms and Effects. New York/ London: Routledge.

• Kebritchi, M., Hirumi, A. & Bai, H., 2010. The effects of modern mathematics computer games on mathematics achievement and class motivation. Computers & education, 55(2), 427-443.

• Klawe, M. & Phillips, e., 1995. A classroom study: electronic games engage children as researchers. CSCl '95 Conference Proceedings. pp. 17-20.

• Klopfer, Eric; Scot Osterweil and Katie Salen (2009). Moving learning games forward,pdf

• Koubek, A. and Macleaod, H. (2004) Game-Based Learning. In Pivec, M., Koubek, A., and Dondi, C. (eds.) Guidelines for Game-Based Learning. Lengerich: Pabst, p.15-19.

• Kron, F.w. et al., 2010. Medical student attitudes toward video games and related new media technologies in medical education. BMC Medical education, 10. HTML

• Lang, F., Pueschel, T. and Neumann, D. (2009). "Serious Gaming for the Evaluation of Market Mechanisms", Proceedings of the International Conference on Information Systems (ICIS) 2009.

• Liebermann, D. A. (1997) Interactive games for health promotion: Effects on knowledge, self-efficacy, social support and health. In R. L. Street, W. R. Gold & T. Manning (Eds.), Health promotion and interactive technology: Theoretical applications and future directions. Mahwah, NJ: Lawrence Erlbaum Associates, p.103-120

• Marsh Tim, Chuang Xuejin, Li Zhiqiang Nickole, Scot Osterweil, Eric Klopfer and Jason Haas, (2011). Fun and learning: the power of narrative, in: FDG, Bordeaux, France, pages 23--29, ACM.

• Mayer, I. & Bekebrede, G., 2006. Serious games and simulation based e-learning for infrastructure management. Affective and emotional aspects of human-computer interaction: emphasis on gamebased and innovative learning approaches. (ed) M Pivec. Amsterdam: iOS Press

• Mcnally, S. & Telhaj, S., 2007. The Cost of exclusion: Counting the cost of youth disadvantage in the uK, Princes trust. PDF

• Michael, D. & Chen, S., 2006. Serious Games: Games that educate, train, and inform, Course technology inc.

• Michael, D. and Chen, S. (2006) Serious Games: Games That Educate, Train and Inform. Boston: Thomson.

• Mitgutsch, K. (2009) Passionate Digital Play-Based Learning, (Re)Learning in computer games like Shadow of the Colossus. Eludamos. Journal for Computer Game Culture., 3 (1), p.9-22.

• Nielsen report, 2009. How teens use Media: A Nielsen report on the myths and realities of teen media trends.

• Oblinger, D. G. (2006a) Games and Learning. Digital games have the potential to bring play back to the learning experience. EDUCAUSE, 29 (3), p.5-7.

• Oblinger, D. G. (2006b) Simulations, Games, and Learning [Online]. PDF, retrieved 13:47, 11 October 2012 (CEST).

• Papert, S. (1998) Does Easy Do It? Children, Games, and Learning. Game Developers Magazine, Vol. 5 (6), p.88.

• Pratchett, r., 2005. Gamers in the UK: Digital play, digital lifestyles, BBC.

• Prensky, Marc (2001). Digital Game-Based Learning, McGraw-Hill.

• Ratan, R., & Ritterfeld, U. (2009) Classifying Serious Games. In Ritterfeld, U., Cody, M., and Vorderer, P. (eds.) Serious Games: Mechanisms and Effects. New York/London: Routledge.

• Reeves, B., Malone, T.W. & O'Driscoll, T., 2008. Leadership's Online labs - Harvard business review. HTML

• Reeves, Byron; Reed, J. Leighton (2009). Total Engagement: Using Games and Virtual Worlds to Change the Way People Work and Businesses Compete. Boston: Harvard Business School Publishing.

• Rieber, L. P. (1996) Seriously considering play: Designing interactive learning environments based on the blending of microworlds, simulations, and games. Educational Technology Research & Development, Vol. 44 (2), p.43-58.

• Ritterfeld Ute; Michael Cody and Peter Vorderer (2009). Serious Games: Mechanisms and Effects, Routledge, ISBN 0415993709

• Ritterfeld, U. and Weber, R. (2006) Video Games for Entertainment and Education. In Vorderer, P. and Bryant, J. (eds.) Playing Video Games. Motives, Responses, and Consequences. Mahwah, NJ: Lawrence Erlbaum Associates, p.399-413.

• Rodriguez, H. (2006) The Playful and the Serious: An Approach to Huizinga's Homo Ludens. Game Studies, Vol. 6 (1).

• Salomon, G. (1984) Television is "Easy" and Print is "Tough": The Differential Investment of Mental Effort in Learning as a Function of Perceptions and Attributions. Journal of Educational Psychology, Vol. 76 (4), p.647-658.

• Sandford, R. et al., 2006. Teaching with Games: using commercial off-the-shelf computer games in formal education, Futurelab. PDF

• Sawyer, B. & Smith, P., 2008. Serious Games taxonomy. PDF

• Sawyer, B. (2003) Serious Games: Improving Public Policy through Game-based Learning and Simulation. Woodrow Wilson International Center for Scholars.

• Sawyer, B. and Smith, P. (2008) Serious Games Taxonomy [Online]. PDF (broken link)

• Sawyer, B., 2009. Ben Sawyer on Games beyond entertainment : Observations, ideas, and Frameworks for Future Serious Games, Mit Media lab lecture. HTML

• Shaffer, D.W., 2005. Epistemic games. Innovate: Journal of Online education, 1(6).

• Shelly, G. B., Cashman, T. J., Gunter, G. A., & Gunter, R. E. (2006). Teachers discovering computers: Integrating technology into the classroom (4th ed.). Cambridge: Course Technology, Inc.

• Shen, C., Wang, H. and Ritterfeld, U. (2009) Serious Games and Seriously Fun Games: Can They Be One and the Same? In Ritterfeld, U., Cody, M., and Vorderer, P. (eds.) Serious Games: Mechanisms and Effects. New York/London: Routledge.

• Shute, V. J., Masduki, I., & Donmez, O. (2010). Conceptual Framework for Modeling, Assessing and Supporting Competencies within Game Environments. Technology Instruction Cognition and Learning, 8(2), 137–161. Retrieved from http://myweb.fsu.edu/vshute/pdf/TICL2010.pdf

• Shute, V. J., Ventura, M., Bauer, M. and Zapata-Rivera, D. (2009) Melding the Power of Serious Games and Embedded Assessment to Monitor and Foster Learning: Flow and Grow. In Ritterfeld, U., Cody, M. and Vorderer, P. (eds.) Serious Games: Mechanisms and Effects. New York/London: Routledge.

• Shute, V.J., Masduki, I. & Donmez, O., Conceptual Framework for Modeling, Assessing, and Supporting Competencies within Game environments. technology, instruction, Cognition, and learning. PDF

• Shute, Valerie J, Iskandaria Masduki, and Oktay Donmez. 2010. Conceptual Framework for Modeling, Assessing and Supporting Competencies within Game Environments. Technology Instruction Cognition and Learning 8, no. 2: 137-161. PDF

• Smith, R., 2006. Technology disruption in the simulation industry. Journal of Defense Modeling and Simulation, 3(1), 3-10.

• Smith, R., 2007. Game impact theory: the five forces that are driving the adoption of game technologies within multiple established industries. Games and Society Yearbook.

• Smith, R.D., 2008. Investigating the disruptive effect of computer game technologies on medical education and training. university of Maryland university College. PDF

• Sorensen, B.H. & Meyer, B., 2007. Serious games in language learning and teaching-a theoretical perspective. in Proceedings of the 2007 Digital Games research Association Conference. pp. 559-566.

• Squire, K. and Jan, M. (2007) Mad City Mystery: Developing Scientific Augmentation Skills with a Place-based Augmented Reality Game on Handheld Computers. Journal of Science Education and Technology, 16 (1), p.5-29.

• Squire, K. and Jenkins, H. (2003) Harnessing the power of games in education. Insight, 3, p.5-33.

• Squire, K., 2005. Changing the game: what happens when video games enter the classroom. innovate: journal of online education, 1(6).

• Stone, B., 2008. Human Factors Guidelines for interactive 3D and Games-based training Systems Design. HTML

• Subrahmanyam, K., and Greenfield, P. M. 1994. Effect of Video Game Practice on Spatial Skills in Girls and Boys. Journal of Applied Developmental Psychology 15, 1, 13-32.

• Susi T.; M. Johannesson, and P. Backlund, (2007). "Serious Games – An Overview," School of Humanities and Informatics, University of Skövde, Sweden, Technical Report HS-IKI-TR-07-001, 2007.

• Swertz, C. (2009) Serious Games Taken Seriously. Eludamos. Journal for Computer Game Culture., 3 (1), p.7-8.

• Terdiman, D., 2006. What's wrong with serious games? - CNet News. CNet News. Available at: HTML

• Thompson D, Baranowski T, Buday R et al. (2010). Serious Video Games for Health: How Behavioral Science Guided the Development of a Serious Video Game. Simulation Gaming vol. 41 no. 4 587-606.

• Ulicsak, M., and Wright, M., 2010. Computer games and learning. Bristol: Futurelab, PDF

• Ulicsak, M., and Wright, M., 2010. Games in Education: Serious games. Bristol: Futurelab, PDF

• Williamson, B., 2009. Computer games, schools, and young people: A report for educators on using games for learning, PDF

• Wong, W. L., Shen, C., Nocera, L., Carriazo, E., Tang, F., Bugga, S., Narayanan, H., Wang, H., Ritterfeld, U. (2007). Serious Video Game Effectiveness. Paper presented at the ACE '07.

• Young, Michael F.; Stephen Slota, Andrew B. Cutter, Gerard Jalette, Greg Mullin, Benedict Lai, Zeus Simeoni, Matthew Tran, Mariya Yukhymenko(2012). Our Princess Is in Another Castle. A Review of Trends in Serious Gaming for Education. Review Of Educational Research March 2012 vol. 82 no. 1 61-89, DOI 10.3102/0034654312436980

• Yusoff, A.; Crowder, R.; Gilbert, L.; Wills, G.; , "A Conceptual Framework for Serious Games," Advanced Learning Technologies, 2009. ICALT 2009. Ninth IEEE International Conference on , vol., no., pp.21-23, 15-17 July 2009 doi: 10.1109/ICALT.2009.19, Abstract/PDF

• Zillmann, D. (1988) Mood management through communication choices. American Behavioral Scientist, 31 (3), p.327-341.

• Zyda, M. (September 2005). "From visual simulation to virtual reality to games", Computer, IEEE. p.25-32.

• Zyda, M., 2005. From visual simulation to virtual reality to games. Computer, 38(9), 25-32.

• van Eck, R. (2006) Digital Game-Based Learning - It's Not Just the Digital Natives Who Are Restless. EDUCAUSE, March/April 2006, p.17-30.

Acknowledgement

The first drafts of the article are strongly based on the Serious game article.