Pedagogic strategy: Difference between revisions
(using an external editor) |
Angolo2022 (talk | contribs) m (→Weston & Cranton: capital letter changed to small letter) |
||
(98 intermediate revisions by 4 users not shown) | |||
Line 1: | Line 1: | ||
{{Incomplete}} | |||
== Definition == | == Definition == | ||
Pedagogic Strategies can be defined at | Pedagogic Strategies can be defined at 3 levels: | ||
# General instructional designs | # General instructional designs | ||
# Pedagogic methods that are | # Designs applied to a teaching/learning unit (e.g. a lesson or a course module) | ||
# [[Pedagogic method]]s that are part of a wider design (e.g. of a pedagogic strategy as defined here) and that we discuss elsewhere. | |||
Effective course designs (or teachers) may make use of different teaching strategies or methods. | |||
According to Dick et al. (2001:184) {{quotation | instructional strategy is used generally to cover the various aspects of sequencing and organizing the content, specifying learning activities, and deciding how to deliver the content and activities.}} | |||
Important notice: [[User:DSchneider|DSchneider]] doesn't feel very sure how to distinguish pedagogic strategies from what he calls [[instructional design model]]s. Here is a provisional distinction: | |||
* Pedagogic strategies refer to a general abstract teaching method. They can influence instructional design models. | |||
* Instructional design models refer to more precise instructional designs (based on some more explicit teaching and learning goals). A model can (but must not) implement several kinds of pedagogic strategies and methods. | |||
Alternative entry points: | |||
* [[Instructional design model]]s (It might be good idea to merge at some point these articles, but then it's sometimes a good idea to look at a similar problem with different instrumentation ...) | |||
* [[Teaching style]] (models that focus on the classroom teacher) | |||
== Types of pedagogic strategies == | |||
Definitions of pedagogic strategies draw often from several fields. | |||
Firstly pedagogic strategies (at least the ones discussed in instructional design) are based on general [[learning theory | learning theoretical]] concepts, e.g. [[Behaviorism]], [[Cognitivism]], [[Constructionism]], [[Constructivism]], [[Socio-constructivism]], [[Situated learning]], etc. | |||
Learning theorists often also address pedagogical issues . There is an overlap between theories that explain how people learn and how one could bring people to learn. This is particularly true regarding larger families of thought like [[constructivism]]. | |||
Second, design of strategies draws a lot from general [[pedagogical theories | pedagogical theory]], but also from specialized research (displinary didactics, school vs. [[vocational training]] etc.). | |||
Third, [[educational technology]] has been a driving force to develop new strategies, with the basic assumption that [[educational technologies]] can facilitate pedagogical scenarios. | |||
=== Ruth Clark four instructional architectures === | |||
According to Merril (2002), Ruth Clark (1998) suggests four different instructional architectures (''receptive'', ''directive'', ''[[guided discovery learning | guided discovery]]'', and ''exploratory'') that he calls instructional style. | |||
In the context of educational technology: | |||
* '''Receptive instruction''' is characterized by a lecture or an Internet site where the student is merely provided with information. | |||
* '''Directive instruction''' is characterized by a computer-based tutorial where information is presented, the student responds, feedback is provided and this tutorial learning cycle is repeated. | |||
* '''Guided discovery''' is characterized by a computer simulation that allows the student to manipulate some device or environment. | |||
* '''Exploratory instruction''' is characterized by an open learning environment in which the student is provided a rich, networked database of information, examples, demonstrations, and exercises from which the student can select whatever is appropriate to their current needs and mental models. | |||
=== Weston & Cranton === | |||
Cynthia Weston and P. A. Cranton (1986:278) defined a still popular taxonomy that relates '''instructional strategies''' to different types of learning contents, i.e. '''domain content levels'''. Different strategies are viewed as useful for different types of contents and learning outcomes. | |||
{| class="wikitable" | |||
|+Matching domain and level of learning to appropriate methods | |||
! Domain & Level !! Method | |||
|- | |||
| colspan="2" |'''Cognitive Domain''' | |||
|- | |||
|Knowledge|| Lecture, programmed instruction, drill and practice | |||
|- | |||
|Comprehension|| Lecture, modularized instruction, programmed instruction | |||
|- | |||
|Application|| Discussion, simulations and games, CAI, modularized instruction, field experience, laboratory | |||
|- | |||
|Analysis|| Discussion, independent/group projects, simulations, field experience, role-playing, laboratory | |||
|- | |||
|Synthesis|| Independent/group projects, field experience, role-playing, laboratory | |||
|- | |||
|Evaluation|| Independent/group projects, field experience, laboratory | |||
|- | |||
| colspan="2" |'''Affective Domain''' | |||
|- | |||
|Receiving|| Lecture, discussion, modularized instruction, field experience | |||
|- | |||
|Responding|| Discussion, simulations, modularized instruction, role-playing, field experience | |||
|- | |||
|Valuing|| Discussion, independent/group projects, simulations, role-playing, field experience | |||
|- | |||
|Organization|| Discussion, independent/group projects, field experience | |||
|- | |||
|Characterization by a Value||Independent projects, field experience | |||
|- | |||
| colspan="2" |'''Psychomotor Domain''' | |||
|- | |||
|Perception|| Demonstration (lecture), drill and practice | |||
|- | |||
|Set|| Demonstration (lecture), drill and practice | |||
|- | |||
|Guided Response|| Peer teaching, games, role-playing, field experience, drill and practice | |||
|- | |||
|Mechanism|| Games, role-playing, field experience, drill and practice | |||
|- | |||
|Complex Overt Response|| Games, field experience | |||
|- | |||
|Adaptation|| Independent projects, games, field experience | |||
|- | |||
|Origination|| Independent projects, games, field experience | |||
|} | |||
=== Baumgartner - Learning I-II-III === | |||
We expand Baumgartner's (2004) learning I-II-III typology with associated pedagogical strategies and instructional design models. | |||
The following table is based on Baumgartner et al. (2004) [[:Image:learning-I-II-II-baumgartner.png | picture]] (up to row 6) and to which we made additions. | |||
<table border="1"> | |||
<tr> | |||
<th>Dominant Strategy</th> | |||
<th>Transfer (teaching I)</th> | |||
<th>Tutoring (teaching II)</th> | |||
<th>Coaching (teaching III)</th> | |||
</tr> | |||
<tr> | |||
<th>Knowledge type</th> | |||
<td>Factual knowledge, "know-that"</td> | |||
<td>Procedural knowledge, "know-how", problem solving, | |||
concepts</td> | |||
<td>Social practice, "knowing in action"</td> | |||
</tr> | |||
<tr> | |||
<th>Aims of Teaching</th> | |||
<td>Transfer of propositional knowledge</td> | |||
<td>Presentation of predetermined problems</td> | |||
<td>Action in (complex and social) situations</td> | |||
</tr> | |||
<tr> | |||
<th>Learning goal</th> | |||
<td>to know, to remember</td> | |||
<td>to do, to practice, to argue</td> | |||
<td>to cope, to master</td> | |||
</tr> | |||
<tr> | |||
<th>Assessment</th> | |||
<td>Production of correct answers</td> | |||
<td>Selection of correct methods and its use</td> | |||
<td>Realization of adequate action strategies</td> | |||
</tr> | |||
<tr> | |||
<th>Learning content type</th> | |||
<td>Verbal knowledge, Memorization</td> | |||
<td>Skill, Ability</td> | |||
<td>Social Responsibility</td> | |||
</tr> | |||
<tr> | |||
<th>Teaching and learning strategies and activities</th> | |||
<td>to teach, to explain</td> | |||
<td>to observe, to help, to demonstrate</td> | |||
<td>to cooperate, to support</td> | |||
</tr> | |||
<tr> | |||
<th>Learning theory</th> | |||
<td>[[Behaviorism]]</td> | |||
<td>[[Cognitivism]]<br> | |||
[[Constructivism]]</td> | |||
<td>[[Socio-constructivism]], [[Situated learning]]<br> | |||
</td> | |||
</tr> | |||
<tr> | |||
<th>Examples of [[instructional design model]]s</th> | |||
<td>[[programmed instruction]],<br> | |||
(simple [[mastery learning]],</td> | |||
<td>[[problem-based learning]],<br> | |||
[[case-based learning]],<br> | |||
Discovery learning with [[simulation]]s, [[microworld]]s, <br> | |||
[[WebQuest]]s,<br> | |||
</td> | |||
<td>[[inquiry-based learning]], [[project-based learning]]<br> | |||
Situated [[discovery learning]] and [[exploratory learning]],</td> | |||
</tr> | |||
<tr> | |||
<th>[[learning level]]</th> | |||
<td>Stimulus-response<br> | |||
Bloom's level 1</td> | |||
<td>chaining, association, discrimination, concept | |||
learning, problem solving<br> | |||
(Blooms levels 1-6)</td> | |||
<td>situated problem solving</td> | |||
</tr> | |||
</table> | |||
=== Schneider's modified learning I-I-III === | |||
* See the [[learning type]] article. The idea is to expand these learning types a bit in order to take into account levels of complexity and also have a slot for orthogonal designs (e.g. that deal with motivation). | |||
{{comment | [[User:DSchneider|DSchneider]] is not yet very sure of this ...}} | |||
<table border="1"> | |||
<tr> | |||
<th colspan="3" rowspan="1"> | |||
Learning categories - suitable for instructional design planning | |||
</th> | |||
</tr> | |||
<tr> | |||
<th>Learning I-II-III</th> | |||
<th>Revised version</th> | |||
<th>Example designs</th> | |||
</tr> | |||
<tr> | |||
<td colspan="1" rowspan="2"> | |||
I: know that | |||
</td> | |||
<td> | |||
I-a '''Facts''' : recall, description, identification, etc. | |||
</td> | |||
<td>[[direct instruction]], [[programmed instruction]], [[mastery learning]], [[e-instruction]]</td> | |||
</tr> | |||
<tr> | |||
<td> | |||
I-b '''Concepts''': discrimination, categorization, discussion, etc. | |||
</td> | |||
<td>[[discovery learning]], | |||
[[exploratory learning]]</td> | |||
</tr> | |||
<tr> | |||
<td colspan="1" rowspan="2"> | |||
II: know how | |||
</td> | |||
<td> | |||
II-a '''Reasoning and procedures''': inferences, deductions, etc. + | |||
procedure application | |||
</td> | |||
<td>drill programs, [[simulation]], [[virtual laboratory]]</td> | |||
</tr> | |||
<tr> | |||
<td> | |||
II-b '''Problem solving and production strategies''': identification of | |||
subgoals + application of heuristics/methods | |||
</td> | |||
<td>[[case-based learning]], | |||
[[inquiry-based learning]], [[problem-based learning]]</td> | |||
</tr> | |||
<tr> | |||
<td> | |||
III: knowing in action | |||
</td> | |||
<td> | |||
III '''Situated action''': action strategies in complex and authentic | |||
situations | |||
</td> | |||
<td>[[project-based learning]]</td> | |||
</tr> | |||
<tr> | |||
<td> | |||
IV: Other | |||
</td> | |||
<td> | |||
<p class="TCell-H2">IV '''Other''': e.g. motivation, | |||
emotion, reflection, i.e. elements that could intervene in all the | |||
other categories</p> | |||
</td> | |||
<td>[[FEASP]], [[learning e-portfolio]]</td> | |||
</tr> | |||
</table> | |||
=== Greeno, Collins and Resnick === | |||
Greeno, Collins and Resnick (1996), based on learning psychological reflection, distinguish between behaviorist, cognitive and situative approaches and formulate ''first principles'' as defined by Brown and Campione (1994). Johri and Olds (2011), in a article on bridging learning sciences and engineering education, created the following table summarizing the headings of the Greeno et al. article and that we reproduce in turn with slight modifications. Numbers of design principles are taken from the original Greeno et al. article. | |||
{| class="wikitable" | |||
|- | |||
! !! Behaviorist !! Cognitive !! Situative | |||
|- | |||
| Nature of knowing || as having associations || as concepts and cognitive abilities || as distributed in the world | |||
|- | |||
| Nature of learning and transfer ||acquiring and applying associations | |||
|acquiring and using conceptual and cognitive structures | |||
|becoming attuned to constraints and affordances through participation | |||
|- | |||
| Nature of motivation and engagement ||extrinisic motivation | |||
|intrinsic motivation | |||
|engaged participation | |||
|- | |||
| '''Design guidelines for learning environments''' ||(b1) Routines of activity for effective transmission of knowledge. | |||
(b2) Clear goals, feedback, and reinforcement. | |||
(b3) Individualization with technologies. | |||
|(c1) Interactive environments for construction of understanding | |||
|(s1) Environments of participation in social practices of inquiry and learning. | |||
(s2) Support for development of positive epistemic identities. | |||
|- | |||
| '''Curricula design guidelines''' ||(b4) Sequences of component-to-composite skills. | |||
|(c2) Sequences of conceptual development. | |||
(c3) Explicit attention to generality. | |||
|(s3) Development of disciplinary practices of discourse and representation. | |||
(s4) Practices of formulating and solving realistic problems | |||
|- | |||
| '''Assessment design guidelines''' ||(b5) Assessment of knowledge components. | |||
|c4) Assessments of extended performance. | |||
(c5) Crediting varieties of excellence. | |||
|(s5) Assessing participation in inquiry and social practices of learning. | |||
(s6) Student participation in assessment. | |||
(s7) Design of assessment systems. | |||
|} | |||
=== Joyce === | |||
Joyce, Weil and Calhoun (2000) defined 4 major families of models for teaching, i.e. strategies that are used in schooling. | |||
# Behavioral systems family of models | |||
# [[Human information processing | Information-processing]] family of models | |||
# Personal family of models | |||
# Social family of models | |||
<table cellspacing="2" cellpadding="2" border="1"> | |||
<tr> | |||
<th>Familiy of models</th> | |||
<th>Description (see Allen)</th> | |||
<th>Examples of Models</th> | |||
</tr> | |||
<tr> | |||
<td>Behavioral systems</td> | |||
<td>To change the behavior of the learner / transmit the culture by teaching skills and knowledge. E.g. the learner is considered to be a system that can be influenced by feedback.</td> | |||
<td> | |||
* [[Mastery learning]], [[Programmed instruction]], [[CBT | Computer drill programs]]<br /> | |||
* [[Direct instruction]]<br /> | |||
* [[Simulation]]s<br /> | |||
</td> | |||
</tr> | |||
<tr> | |||
<td>Information-processing</td> | |||
<td>To improve logical thinking processes. This includes search for information, concept learning, hypothis formulation and testing, creative thinking.</td> | |||
<td> | |||
* Inductive thinking: find and organize information leading to concept formation) (H. Taba)<br /> | |||
* Concept attainment: teaching concepts and helping to students to develop concepts, (J. Bruner)<br /> | |||
* Memorization: strategies for memorizing and assimilatating information<br /> | |||
* [[Advance Organizer]]s: provide learners with the cognitive structure to understand complex materials (Ausubel). | |||
* Scientific Inquiry: teach how to collect and analyze data, and test hypothesis and theories. (e.g. [[inquiry-based learning]]<br /> | |||
* Inquiry training: Engage students in causal reasoning, i.e. ask questions, build concepts and hypothesis and test them.<br /> | |||
* Synectics: creative thought, i.e. help students to "break set" in problem-solving and writing activities<br /> | |||
</td> | |||
</tr> | |||
<tr> | |||
<td>Personal/Individual family</td> | |||
<td>To take into account particular traits of individuals and to analyse them. This includes meta-cognitive activities to develop internal resources to see things in new/different ways. </td> | |||
<td> | |||
* Nondirective (facilitative) teaching (Rodgers)<br /> | |||
* Enchancing self-esteem, development of self concepts</td> | |||
</tr> | |||
<tr> | |||
<td>Social family</td> | |||
<td> | |||
Build learning communities that profit from interactions between learnings.<br> | |||
At the strategic level: to teach learning by apprenticeship, social skills and communication. | |||
</td> | |||
<td> | |||
* Partners in learning ([[collaborative learning]])<br /> | |||
* Group investigation <br /> | |||
* Role Plays including values clarification, e.g. as in [[Simulation and gaming]]<br /> | |||
* Jurisprudential inquiry</td> | |||
</tr> | |||
</table> | |||
Update (2015): This book is now in it's 9th edition and includes additions. Joyce, B., Weil, M., Calhoun, E. (2014). Models of Teaching (9th Edition) Hardcover, 9th edition, Pearson, ISBN 0133749304 | |||
. | |||
=== Reeves' pedagogical dimensions of computer-based education === | |||
Reeves (and Reeves) proposed several variants of a multi-dimensional model that allows categorization of various computer-based pedagogical designs. Identified pedagogical dimensions can be used to compare one form of Computer-based-education (CBE) with another or to compare different implementations of the same form of CBE. Reeves' motivation was the claim that {{quotation | Systematic evaluation of computer-based education (CBE) in all its various forms (including integrated learning systems, interactive multimedia, interactive learning environments, and microworlds) often lags behind development efforts (Flagg, 1990).}} (Reeves, 1997). The authors identifies frour reasons: (1) Technological innovations advertized as beeing effective are taken to be effective. This is reinforced by industry spending more money on marketing than on evaluation. (2) Decision makers are more interested in numbers dealing with technology investements, spread and quantitative use of CBE in the school system. (3) Evaluation formats are indadequate, e.g. {{quotation | evaluation reports are usually presented in the format of social science research reports, a format that "is almost useless for most clients and audiences" (Scriven, 1993, p. 77)}} (Reeves, 1997). | |||
(4) Evaluators often compare the incomparable. {{quotation | A major weakness in traditional empirical approaches to evaluation is that the treatments being compared (e.g., interactive multimedia versus classroom instruction) are often assumed to be cohesive, holistic entities with meaningful differences.}}(Reeves, 1997). | |||
{{quotation | Berman and McLaughlin (1978) and other implementation researchers (Cooley and Lohnes, 1976) have illustrated the fallacy of assuming that meaningful differences exist between two programs just because they have different names. It is imperative to open up the "black boxes" of instructional alternatives and reveal the relevant pedagogical dimensions they express if evaluations are to be meaningful and have utility. Pedagogical dimensions are the keys to unlocking the black boxes of various forms of CBE.}} (Reeves, 1997). | |||
<table border="1"> | |||
<tr><th>Dimensions</th><th>Scales (2 ends)</th> | |||
<tr><td>Pedagogical epistemology</td> <td> objectivism - constructivism</td> | |||
</tr> | |||
<tr><td>Pedagogical philosophy (Epistempology)</td> <td> instructivism - constructivism</td> | |||
</tr> | |||
<tr><td>Underlying psychology (Learning theory)</td> <td> behavioriral - cognitive</td> | |||
</tr> | |||
<tr><td>Goal orientation (learning objectives)</td> <td> sharply focused (precise) - unfocused (general)</td> | |||
</tr> | |||
<tr><td>Experiental validity (orientation of the activity)</td> <td> abstract (academic) - concrete (applied). | |||
On an other scale: reproduce, classify, explain, apply, invent, solve a problem.</td> | |||
</tr> | |||
<tr><td>Teacher role</td> <td> didactic - facilitative</td> | |||
</tr> | |||
<tr><td>Flexibility</td> <td> teacher-proof - easily modifiable</td> | |||
</tr> | |||
<tr><td>Value of errors</td> <td> errorless learning - learning from experience</td> | |||
</tr> | |||
<tr><td>Origin of motivation</td> <td> extrinsic - intrinsic</td> | |||
</tr> | |||
<tr><td>Accommodation of Individual Differences</td> <td> non-existant - multi-faceted</td> | |||
</tr> | |||
<tr><td>Learner control</td> <td> non-existant - unrestricted</td> | |||
</tr> | |||
<tr><td>User activity</td> <td> mathemagenic - generative</td> | |||
</tr> | |||
<tr><td>Cooperative learning</td> <td> unsupported - integral</td> | |||
</tr> | |||
<tr><td>Cultural sensitivity</td> <td> non-existent - integral</td> | |||
</tr> | |||
</table> | |||
While these dimensions rather represent a framework for comparative analysis, this table also can be use to think about the design of a pedagogical scenario. | |||
=== Bates choosing === | |||
Tony Bates his [https://opentextbc.ca/teachinginadigitalage/ free online book] on ''Teaching in a Digital Age: Guidelines for Designing Teaching and Learning'' presented a short table that is based on five criteria: Epistemological basis, industrial vs. digital skills (20st vs. 21st century ones), academic quality, and flexibility. | |||
[[File:Bates-2015-chosing-design-models.jpg|400px|thumb|none|Bates (2015) Choosing design models (CC BY NC SA license)]] | |||
=== According to learning style === | |||
The idea is that different pedagogies are better adapted to individuals preferences for given learning styles. | |||
See the [[learning style]] article. | |||
== Major families according to learning theoretical considerations == | |||
{{stub}} | |||
{{comment | This needs to be completed, my plan is make short summaries for each and then point to instructional design models (as shown with a few examples below) - [[User:DSchneider|DSchneider]] 19:32, 22 May 2006 (MEST) }} | |||
=== Behaviorist strategies === | |||
* [[Direct instruction]] | |||
* [[Programmed instruction]] | |||
* [[Mastery learning]] | |||
=== Cognitivist strategies === | |||
* [[Nine events of instruction]] | |||
=== Cognitivist/Constructivist strategies === | |||
* [[Microworld]]s | |||
* [[Problem-based learning]] | |||
== | === Constructivist/Situated strategies === | ||
* [[Inquiry-based learning]] | * [[Inquiry-based learning]] | ||
* [[Project-based learning]] | * [[Project-based learning]] | ||
== Links == | |||
* Allen (1996), Instructional Models Key, [http://www.humboldt.edu/~tha1/key.html HTML]. | |||
* Conaway, J. (1997) Educational technologies effect on models of instruction. University of Delaware. [http://copland.udel.edu/~jconway/EDST666.htm HTML], retrieved 15:45, 11 August 2007 (MEST). A good and short overview of instructional models. | |||
* Huitt, W. (2003). Classroom instruction. Educational Psychology Interactive. Valdosta, GA: Valdosta State University. Retrieved 19:24, 22 May 2006 (MEST), from http://chiron.valdosta.edu/whuitt/col/instruct/instruct.html. (This is an excellent resource for classroom instruction / direct instruction). | |||
* [http://educ3.utsa.edu/pmcgee/models.htm Models of Teaching], College of Education and Human Development, UTSA. (Good resources for educators who are interested in approaches to and models of teaching) | |||
* Cynthia A Gray/Portfolio 2006, [http://www.uwec.edu/grayca/webpgs2/reflection.htm Reflections on Teaching Models]. This is a nice matrix of nine teaching/learning models. | |||
* [http://www.adprima.com/teachmeth.htm Instructional Methods Information] by Bob Kizlik (creator of ADPRIMA) | |||
* [http://www.positivepractices.com/EducationalTechnology/Syllabus.html#Table1.TableofInstructionalMethods Table of Instructional Methods] (Center for Positive Practices) | |||
# | |||
* [http://docs.google.com/View?docid=dhbqfq9m_0f6mdc2 DC Education Application Profile: Candidate Vocabularies for Instructional Method and Type]. A Nice table summarizing vocabularies describing instructional method and types (for use in [[metadata]] descriptions) | |||
== References == | == References == | ||
* Baumgartner, P., I. Bergner und L. Pullich (2004). Weblogs in Education - A Means for Organisational Change. In: Multimedia Applications in Education Conference (MApEC) Proceedings 2004. L. Zimmermann. Graz: 155-166. [http://www.peter.baumgartner.name/article-en/weblogs-in-education-a-means-for-organisational-change/ PDF] | |||
* Baumgartner, P. (2004). The Zen Art of Teaching - Communication and Interactions in eEducation. Proceedings of the International Workshop ICL2004, Villach / Austria 29 September-1 October 2004, Villach, Kassel University Press. CD-ROM, ISBN: 3-89958-089-3. [http://www.peter.baumgartner.name/article-en/the-zen-art-of-teaching/ PDF] | |||
* Berman, P., and McLaughlin, M. (1978). Federal programs supporting education change. A model of education change, Vol. VIII: Implementing and sustaining innovations. Santa Monica, CA: Rand. | |||
* Cooley, W. W., and Lohnes, P. R. (1976). Evaluation research in education. New York: Irvington. | |||
* Chamberland, G., L. Lavoie et D. Marquis (1995). ''20 formules pédagogiques'', Sainte-Foy: Presses universitaires du Québec. | * Chamberland, G., L. Lavoie et D. Marquis (1995). ''20 formules pédagogiques'', Sainte-Foy: Presses universitaires du Québec. | ||
* Clark, Ruth (1998). Building Expertise: Cognitive Methods for Training and Performance Improvement. Washington D.C.: International Society for Performance Improvement. | |||
* Derry, S. J., & Steinkuehler, C. A. (2003). Cognitive and situative theories of learning and instruction. In L. Nadel (Ed.), Encyclopedia of cognitive science (pp. 800–805). London, UK: Nature Publishing Group. | |||
* Dillon, J.T. Using diverse styles of teaching, [http://faculty.ed.uiuc.edu/westbury/JCS/VOL30/dillon.html HTML] (retrieved 19:24, 22 May 2006 (MEST)) | |||
* Flagg, B. N. (1990). Formative evaluation for educational technologies. Hillsdale, NJ: Lawrence Erlbaum. | |||
* Greeno, J., Collins, A., & Resnick, L. (1996). Cognition and learning. In R. Calfee & D. Berliner (Eds.), Handbook of educational psychology (pp. 15–46). New York, NY: MacMillan. | |||
* Johri, A., & Olds, B. M. (2011). Situated engineering learning: Bridging engineering education research and the learning sciences. Journal of Engineering Education, 100(1), 151-185. https://onlinelibrary.wiley.com/doi/epdf/10.1002/j.2168-9830.2011.tb00007.x | |||
* Kahn, Badrul H. A Framework for Web-Based Learning, in Khan, B.H. (ed) Web-Based Training ISBN 0-87778-303-9 | * Kahn, Badrul H. A Framework for Web-Based Learning, in Khan, B.H. (ed) Web-Based Training ISBN 0-87778-303-9 | ||
* Mafune, Patricia, Teaching and Learning Models [http://hagar.up.ac.za/catts/learner/patriciam/B3a.htm HTML] (retrieved 19:24, 22 May 2006 (MEST) ). | |||
* Hassard, Jack, 2004, ''The Art of Teaching Science'', Oxford Univesity Press. | |||
* Hassard, Jack, 2005, ''The Art of Teaching Science'', Syllabus Helpers and Agenda Strategies to support the "Art of Teaching Science" book. [http://artofteachingscience.org/text/ast.html HTML] | |||
* Hassard, Jack, 2000, Minds ON Science Online, A Web Course on Teaching Science, Georgia State, [http://scied.gsu.edu/Hassard/mos/mos.html] (this is a very '''nice on-line open access book''' on learning theory and models of science teaching). | |||
* Hassard, Jack, Using the Internet As An Effective Science Teaching Tool, [http://www2.gsu.edu/~mstjrh/berseminar.html HTML] | |||
* Honebein, P. C., & Honebein, C. H. (2014). The influence of cognitive domain content levels and gender on designer judgments regarding useful instructional methods. Educational Technology Research and Development, 62(1), 53-69. http://link.springer.com/article/10.1007/s11423-013-9322-5 | |||
* ( | * Merrill, M. D. (2002). Instructional strategies and learning styles: which takes precedence? In R. A. Reiser & J. V. Dempsey (Eds.), Trends and Issues in Instructional Technology. (pp. 99-106). Columbus, OH: Prentice Hall. [http://cito.byuh.edu/merrill/text/papers/5LearningStyles.PDF PDF Preprint] | ||
* Molenda, M. (2005). A New Typology of Instructional Methods Communication, paper presented at the 18th Annual Conference on Distance Teaching and Learning. http://www.uwex.edu/disted/conference/resource_library/proceedings/02_45.pdf | |||
* Séminaire sur les méthodes d'enseignement (1999) La didactique internationale en management public [http://enap.uquebec.ca/seminaires-nov98/cahierdu.htm] | |||
* Joyce, B., Weil, M., Calhoun, E. : (2000). Models of teaching, 6th edition, Allyn & Bacon, 2000. ISBN 0205389279 | |||
* Joyce, B., & Weil, M., & Calhoun, E. (2003). Models of teaching (7th ed.). Englewood Cliffs, NJ: Prentice-Hall. | |||
* Philips, Rob (1998). Models of learning appropriate to educational applications of information technology, eaching and Learning Forum, held at the University of Western Australia. [http://www.tlc.murdoch.edu.au/eddev/eddesign/modelsoflearning.html HTML] | |||
* Reeves, Tom, C. (1997). Evaluating What Really Matters in Computer-Based Education [http://eduworks.com/Documents/Workshops/EdMedia1998/docs/reeves.html HTML], [http://www.educationau.edu.au/jahia/Jahia/home/pid/179 HTML] - [http://www.medicine.mcgill.ca/ibroedu/review/Reeves%20Evaluating%20What%20Really%20Matters%20in%20Computer-Based%20Education.htm HTML copy] | |||
* Reeves, T. C. (1993). Pseudoscience in computer-based instruction: The case of learner control research. Journal of Computer-Based Instruction, 20(2), 39-46. | |||
* Reeves, T. C. (1992a). Evaluating schools infused with technology. Education and Urban Society Journal, 24(4), 519-534. | |||
* Reeves, T. C. (1992b, September). Effective dimensions of interactive learning systems. Invited keynote paper presented at the Information Technology for Training and Education (ITTE `92) Conference, Queensland, Australia. | |||
* Reeves, T.C., Reeves, P.M., (1997b) Effective Dimensions of Interactive Learning on the World Wide Web, in B Khan (Ed.), Web-Based Instruction, Englewood Cliffs N.J. : Educational Technology Publications, 59-66). | |||
* Scriven, M. (1993). Hard-won lessons in program evaluation. San Francisco, CA: Jossey-Bass. | |||
* Van Wart, Montgomery, N. Joseph Cayer, et Steeve Cook; Handbook of Training and Developement for the Public Sector; San Francisco, CA; Jossey-Bass; 1993 | * Van Wart, Montgomery, N. Joseph Cayer, et Steeve Cook; Handbook of Training and Developement for the Public Sector; San Francisco, CA; Jossey-Bass; 1993 | ||
* Weston, C., & Cranton, P. A.. (1986). Selecting Instructional Strategies. The Journal of Higher Education, 57(3), 259–288. http://doi.org/10.2307/1981553 | |||
(need some more) | (need some more) | ||
[[Category:Pedagogic strategies]] | [[Category:Pedagogic strategies]] | ||
[[Category:Educational theories]] | |||
[[Category:Overviews]] | |||
[[Category: Taxonomies]] |
Latest revision as of 10:49, 10 November 2022
Definition
Pedagogic Strategies can be defined at 3 levels:
- General instructional designs
- Designs applied to a teaching/learning unit (e.g. a lesson or a course module)
- Pedagogic methods that are part of a wider design (e.g. of a pedagogic strategy as defined here) and that we discuss elsewhere.
Effective course designs (or teachers) may make use of different teaching strategies or methods.
According to Dick et al. (2001:184) “instructional strategy is used generally to cover the various aspects of sequencing and organizing the content, specifying learning activities, and deciding how to deliver the content and activities.”
Important notice: DSchneider doesn't feel very sure how to distinguish pedagogic strategies from what he calls instructional design models. Here is a provisional distinction:
- Pedagogic strategies refer to a general abstract teaching method. They can influence instructional design models.
- Instructional design models refer to more precise instructional designs (based on some more explicit teaching and learning goals). A model can (but must not) implement several kinds of pedagogic strategies and methods.
Alternative entry points:
- Instructional design models (It might be good idea to merge at some point these articles, but then it's sometimes a good idea to look at a similar problem with different instrumentation ...)
- Teaching style (models that focus on the classroom teacher)
Types of pedagogic strategies
Definitions of pedagogic strategies draw often from several fields.
Firstly pedagogic strategies (at least the ones discussed in instructional design) are based on general learning theoretical concepts, e.g. Behaviorism, Cognitivism, Constructionism, Constructivism, Socio-constructivism, Situated learning, etc. Learning theorists often also address pedagogical issues . There is an overlap between theories that explain how people learn and how one could bring people to learn. This is particularly true regarding larger families of thought like constructivism.
Second, design of strategies draws a lot from general pedagogical theory, but also from specialized research (displinary didactics, school vs. vocational training etc.).
Third, educational technology has been a driving force to develop new strategies, with the basic assumption that educational technologies can facilitate pedagogical scenarios.
Ruth Clark four instructional architectures
According to Merril (2002), Ruth Clark (1998) suggests four different instructional architectures (receptive, directive, guided discovery, and exploratory) that he calls instructional style.
In the context of educational technology:
- Receptive instruction is characterized by a lecture or an Internet site where the student is merely provided with information.
- Directive instruction is characterized by a computer-based tutorial where information is presented, the student responds, feedback is provided and this tutorial learning cycle is repeated.
- Guided discovery is characterized by a computer simulation that allows the student to manipulate some device or environment.
- Exploratory instruction is characterized by an open learning environment in which the student is provided a rich, networked database of information, examples, demonstrations, and exercises from which the student can select whatever is appropriate to their current needs and mental models.
Weston & Cranton
Cynthia Weston and P. A. Cranton (1986:278) defined a still popular taxonomy that relates instructional strategies to different types of learning contents, i.e. domain content levels. Different strategies are viewed as useful for different types of contents and learning outcomes.
Domain & Level | Method |
---|---|
Cognitive Domain | |
Knowledge | Lecture, programmed instruction, drill and practice |
Comprehension | Lecture, modularized instruction, programmed instruction |
Application | Discussion, simulations and games, CAI, modularized instruction, field experience, laboratory |
Analysis | Discussion, independent/group projects, simulations, field experience, role-playing, laboratory |
Synthesis | Independent/group projects, field experience, role-playing, laboratory |
Evaluation | Independent/group projects, field experience, laboratory |
Affective Domain | |
Receiving | Lecture, discussion, modularized instruction, field experience |
Responding | Discussion, simulations, modularized instruction, role-playing, field experience |
Valuing | Discussion, independent/group projects, simulations, role-playing, field experience |
Organization | Discussion, independent/group projects, field experience |
Characterization by a Value | Independent projects, field experience |
Psychomotor Domain | |
Perception | Demonstration (lecture), drill and practice |
Set | Demonstration (lecture), drill and practice |
Guided Response | Peer teaching, games, role-playing, field experience, drill and practice |
Mechanism | Games, role-playing, field experience, drill and practice |
Complex Overt Response | Games, field experience |
Adaptation | Independent projects, games, field experience |
Origination | Independent projects, games, field experience |
Baumgartner - Learning I-II-III
We expand Baumgartner's (2004) learning I-II-III typology with associated pedagogical strategies and instructional design models. The following table is based on Baumgartner et al. (2004) picture (up to row 6) and to which we made additions.
Dominant Strategy | Transfer (teaching I) | Tutoring (teaching II) | Coaching (teaching III) |
---|---|---|---|
Knowledge type | Factual knowledge, "know-that" | Procedural knowledge, "know-how", problem solving, concepts | Social practice, "knowing in action" |
Aims of Teaching | Transfer of propositional knowledge | Presentation of predetermined problems | Action in (complex and social) situations |
Learning goal | to know, to remember | to do, to practice, to argue | to cope, to master |
Assessment | Production of correct answers | Selection of correct methods and its use | Realization of adequate action strategies |
Learning content type | Verbal knowledge, Memorization | Skill, Ability | Social Responsibility |
Teaching and learning strategies and activities | to teach, to explain | to observe, to help, to demonstrate | to cooperate, to support |
Learning theory | Behaviorism | Cognitivism Constructivism |
Socio-constructivism, Situated learning |
Examples of instructional design models | programmed instruction, (simple mastery learning, |
problem-based learning, case-based learning, |
inquiry-based learning, project-based learning Situated discovery learning and exploratory learning, |
learning level | Stimulus-response Bloom's level 1 |
chaining, association, discrimination, concept
learning, problem solving |
situated problem solving |
Schneider's modified learning I-I-III
- See the learning type article. The idea is to expand these learning types a bit in order to take into account levels of complexity and also have a slot for orthogonal designs (e.g. that deal with motivation).
- DSchneider is not yet very sure of this ...
Learning categories - suitable for instructional design planning |
||
---|---|---|
Learning I-II-III | Revised version | Example designs |
I: know that |
I-a Facts : recall, description, identification, etc. |
direct instruction, programmed instruction, mastery learning, e-instruction |
I-b Concepts: discrimination, categorization, discussion, etc. |
discovery learning, exploratory learning | |
II: know how |
II-a Reasoning and procedures: inferences, deductions, etc. + procedure application |
drill programs, simulation, virtual laboratory |
II-b Problem solving and production strategies: identification of subgoals + application of heuristics/methods |
case-based learning, inquiry-based learning, problem-based learning | |
III: knowing in action |
III Situated action: action strategies in complex and authentic situations |
project-based learning |
IV: Other |
IV Other: e.g. motivation, emotion, reflection, i.e. elements that could intervene in all the other categories |
FEASP, learning e-portfolio |
Greeno, Collins and Resnick
Greeno, Collins and Resnick (1996), based on learning psychological reflection, distinguish between behaviorist, cognitive and situative approaches and formulate first principles as defined by Brown and Campione (1994). Johri and Olds (2011), in a article on bridging learning sciences and engineering education, created the following table summarizing the headings of the Greeno et al. article and that we reproduce in turn with slight modifications. Numbers of design principles are taken from the original Greeno et al. article.
Behaviorist | Cognitive | Situative | |
---|---|---|---|
Nature of knowing | as having associations | as concepts and cognitive abilities | as distributed in the world |
Nature of learning and transfer | acquiring and applying associations | acquiring and using conceptual and cognitive structures | becoming attuned to constraints and affordances through participation |
Nature of motivation and engagement | extrinisic motivation | intrinsic motivation | engaged participation |
Design guidelines for learning environments | (b1) Routines of activity for effective transmission of knowledge.
(b2) Clear goals, feedback, and reinforcement. (b3) Individualization with technologies. |
(c1) Interactive environments for construction of understanding | (s1) Environments of participation in social practices of inquiry and learning.
(s2) Support for development of positive epistemic identities. |
Curricula design guidelines | (b4) Sequences of component-to-composite skills. | (c2) Sequences of conceptual development.
(c3) Explicit attention to generality. |
(s3) Development of disciplinary practices of discourse and representation.
(s4) Practices of formulating and solving realistic problems |
Assessment design guidelines | (b5) Assessment of knowledge components. | c4) Assessments of extended performance.
(c5) Crediting varieties of excellence. |
(s5) Assessing participation in inquiry and social practices of learning.
(s6) Student participation in assessment. (s7) Design of assessment systems. |
Joyce
Joyce, Weil and Calhoun (2000) defined 4 major families of models for teaching, i.e. strategies that are used in schooling.
- Behavioral systems family of models
- Information-processing family of models
- Personal family of models
- Social family of models
Familiy of models | Description (see Allen) | Examples of Models |
---|---|---|
Behavioral systems | To change the behavior of the learner / transmit the culture by teaching skills and knowledge. E.g. the learner is considered to be a system that can be influenced by feedback. | |
Information-processing | To improve logical thinking processes. This includes search for information, concept learning, hypothis formulation and testing, creative thinking. |
|
Personal/Individual family | To take into account particular traits of individuals and to analyse them. This includes meta-cognitive activities to develop internal resources to see things in new/different ways. |
|
Social family |
Build learning communities that profit from interactions between learnings. |
|
Update (2015): This book is now in it's 9th edition and includes additions. Joyce, B., Weil, M., Calhoun, E. (2014). Models of Teaching (9th Edition) Hardcover, 9th edition, Pearson, ISBN 0133749304 .
Reeves' pedagogical dimensions of computer-based education
Reeves (and Reeves) proposed several variants of a multi-dimensional model that allows categorization of various computer-based pedagogical designs. Identified pedagogical dimensions can be used to compare one form of Computer-based-education (CBE) with another or to compare different implementations of the same form of CBE. Reeves' motivation was the claim that “Systematic evaluation of computer-based education (CBE) in all its various forms (including integrated learning systems, interactive multimedia, interactive learning environments, and microworlds) often lags behind development efforts (Flagg, 1990).” (Reeves, 1997). The authors identifies frour reasons: (1) Technological innovations advertized as beeing effective are taken to be effective. This is reinforced by industry spending more money on marketing than on evaluation. (2) Decision makers are more interested in numbers dealing with technology investements, spread and quantitative use of CBE in the school system. (3) Evaluation formats are indadequate, e.g. “evaluation reports are usually presented in the format of social science research reports, a format that "is almost useless for most clients and audiences" (Scriven, 1993, p. 77)” (Reeves, 1997). (4) Evaluators often compare the incomparable. “A major weakness in traditional empirical approaches to evaluation is that the treatments being compared (e.g., interactive multimedia versus classroom instruction) are often assumed to be cohesive, holistic entities with meaningful differences.”(Reeves, 1997).
“Berman and McLaughlin (1978) and other implementation researchers (Cooley and Lohnes, 1976) have illustrated the fallacy of assuming that meaningful differences exist between two programs just because they have different names. It is imperative to open up the "black boxes" of instructional alternatives and reveal the relevant pedagogical dimensions they express if evaluations are to be meaningful and have utility. Pedagogical dimensions are the keys to unlocking the black boxes of various forms of CBE.” (Reeves, 1997).
Dimensions | Scales (2 ends) |
---|---|
Pedagogical epistemology | objectivism - constructivism |
Pedagogical philosophy (Epistempology) | instructivism - constructivism |
Underlying psychology (Learning theory) | behavioriral - cognitive |
Goal orientation (learning objectives) | sharply focused (precise) - unfocused (general) |
Experiental validity (orientation of the activity) | abstract (academic) - concrete (applied). On an other scale: reproduce, classify, explain, apply, invent, solve a problem. |
Teacher role | didactic - facilitative |
Flexibility | teacher-proof - easily modifiable |
Value of errors | errorless learning - learning from experience |
Origin of motivation | extrinsic - intrinsic |
Accommodation of Individual Differences | non-existant - multi-faceted |
Learner control | non-existant - unrestricted |
User activity | mathemagenic - generative |
Cooperative learning | unsupported - integral |
Cultural sensitivity | non-existent - integral |
While these dimensions rather represent a framework for comparative analysis, this table also can be use to think about the design of a pedagogical scenario.
Bates choosing
Tony Bates his free online book on Teaching in a Digital Age: Guidelines for Designing Teaching and Learning presented a short table that is based on five criteria: Epistemological basis, industrial vs. digital skills (20st vs. 21st century ones), academic quality, and flexibility.
According to learning style
The idea is that different pedagogies are better adapted to individuals preferences for given learning styles.
See the learning style article.
Major families according to learning theoretical considerations
- This needs to be completed, my plan is make short summaries for each and then point to instructional design models (as shown with a few examples below) - DSchneider 19:32, 22 May 2006 (MEST)
Behaviorist strategies
Cognitivist strategies
Cognitivist/Constructivist strategies
Constructivist/Situated strategies
Links
- Allen (1996), Instructional Models Key, HTML.
- Conaway, J. (1997) Educational technologies effect on models of instruction. University of Delaware. HTML, retrieved 15:45, 11 August 2007 (MEST). A good and short overview of instructional models.
- Huitt, W. (2003). Classroom instruction. Educational Psychology Interactive. Valdosta, GA: Valdosta State University. Retrieved 19:24, 22 May 2006 (MEST), from http://chiron.valdosta.edu/whuitt/col/instruct/instruct.html. (This is an excellent resource for classroom instruction / direct instruction).
- Models of Teaching, College of Education and Human Development, UTSA. (Good resources for educators who are interested in approaches to and models of teaching)
- Cynthia A Gray/Portfolio 2006, Reflections on Teaching Models. This is a nice matrix of nine teaching/learning models.
- Instructional Methods Information by Bob Kizlik (creator of ADPRIMA)
- Table of Instructional Methods (Center for Positive Practices)
- DC Education Application Profile: Candidate Vocabularies for Instructional Method and Type. A Nice table summarizing vocabularies describing instructional method and types (for use in metadata descriptions)
References
- Baumgartner, P., I. Bergner und L. Pullich (2004). Weblogs in Education - A Means for Organisational Change. In: Multimedia Applications in Education Conference (MApEC) Proceedings 2004. L. Zimmermann. Graz: 155-166. PDF
- Baumgartner, P. (2004). The Zen Art of Teaching - Communication and Interactions in eEducation. Proceedings of the International Workshop ICL2004, Villach / Austria 29 September-1 October 2004, Villach, Kassel University Press. CD-ROM, ISBN: 3-89958-089-3. PDF
- Berman, P., and McLaughlin, M. (1978). Federal programs supporting education change. A model of education change, Vol. VIII: Implementing and sustaining innovations. Santa Monica, CA: Rand.
- Cooley, W. W., and Lohnes, P. R. (1976). Evaluation research in education. New York: Irvington.
- Chamberland, G., L. Lavoie et D. Marquis (1995). 20 formules pédagogiques, Sainte-Foy: Presses universitaires du Québec.
- Clark, Ruth (1998). Building Expertise: Cognitive Methods for Training and Performance Improvement. Washington D.C.: International Society for Performance Improvement.
- Derry, S. J., & Steinkuehler, C. A. (2003). Cognitive and situative theories of learning and instruction. In L. Nadel (Ed.), Encyclopedia of cognitive science (pp. 800–805). London, UK: Nature Publishing Group.
- Dillon, J.T. Using diverse styles of teaching, HTML (retrieved 19:24, 22 May 2006 (MEST))
- Flagg, B. N. (1990). Formative evaluation for educational technologies. Hillsdale, NJ: Lawrence Erlbaum.
- Greeno, J., Collins, A., & Resnick, L. (1996). Cognition and learning. In R. Calfee & D. Berliner (Eds.), Handbook of educational psychology (pp. 15–46). New York, NY: MacMillan.
- Johri, A., & Olds, B. M. (2011). Situated engineering learning: Bridging engineering education research and the learning sciences. Journal of Engineering Education, 100(1), 151-185. https://onlinelibrary.wiley.com/doi/epdf/10.1002/j.2168-9830.2011.tb00007.x
- Kahn, Badrul H. A Framework for Web-Based Learning, in Khan, B.H. (ed) Web-Based Training ISBN 0-87778-303-9
- Mafune, Patricia, Teaching and Learning Models HTML (retrieved 19:24, 22 May 2006 (MEST) ).
- Hassard, Jack, 2004, The Art of Teaching Science, Oxford Univesity Press.
- Hassard, Jack, 2005, The Art of Teaching Science, Syllabus Helpers and Agenda Strategies to support the "Art of Teaching Science" book. HTML
- Hassard, Jack, 2000, Minds ON Science Online, A Web Course on Teaching Science, Georgia State, [1] (this is a very nice on-line open access book on learning theory and models of science teaching).
- Hassard, Jack, Using the Internet As An Effective Science Teaching Tool, HTML
- Honebein, P. C., & Honebein, C. H. (2014). The influence of cognitive domain content levels and gender on designer judgments regarding useful instructional methods. Educational Technology Research and Development, 62(1), 53-69. http://link.springer.com/article/10.1007/s11423-013-9322-5
- Merrill, M. D. (2002). Instructional strategies and learning styles: which takes precedence? In R. A. Reiser & J. V. Dempsey (Eds.), Trends and Issues in Instructional Technology. (pp. 99-106). Columbus, OH: Prentice Hall. PDF Preprint
- Molenda, M. (2005). A New Typology of Instructional Methods Communication, paper presented at the 18th Annual Conference on Distance Teaching and Learning. http://www.uwex.edu/disted/conference/resource_library/proceedings/02_45.pdf
- Séminaire sur les méthodes d'enseignement (1999) La didactique internationale en management public [2]
- Joyce, B., Weil, M., Calhoun, E. : (2000). Models of teaching, 6th edition, Allyn & Bacon, 2000. ISBN 0205389279
- Joyce, B., & Weil, M., & Calhoun, E. (2003). Models of teaching (7th ed.). Englewood Cliffs, NJ: Prentice-Hall.
- Philips, Rob (1998). Models of learning appropriate to educational applications of information technology, eaching and Learning Forum, held at the University of Western Australia. HTML
- Reeves, Tom, C. (1997). Evaluating What Really Matters in Computer-Based Education HTML, HTML - HTML copy
- Reeves, T. C. (1993). Pseudoscience in computer-based instruction: The case of learner control research. Journal of Computer-Based Instruction, 20(2), 39-46.
- Reeves, T. C. (1992a). Evaluating schools infused with technology. Education and Urban Society Journal, 24(4), 519-534.
- Reeves, T. C. (1992b, September). Effective dimensions of interactive learning systems. Invited keynote paper presented at the Information Technology for Training and Education (ITTE `92) Conference, Queensland, Australia.
- Reeves, T.C., Reeves, P.M., (1997b) Effective Dimensions of Interactive Learning on the World Wide Web, in B Khan (Ed.), Web-Based Instruction, Englewood Cliffs N.J. : Educational Technology Publications, 59-66).
- Scriven, M. (1993). Hard-won lessons in program evaluation. San Francisco, CA: Jossey-Bass.
- Van Wart, Montgomery, N. Joseph Cayer, et Steeve Cook; Handbook of Training and Developement for the Public Sector; San Francisco, CA; Jossey-Bass; 1993
- Weston, C., & Cranton, P. A.. (1986). Selecting Instructional Strategies. The Journal of Higher Education, 57(3), 259–288. http://doi.org/10.2307/1981553
(need some more)