Research methodology resources: Difference between revisions

The educational technology and digital learning wiki
Jump to navigation Jump to search
 
(71 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{Incomplete}}
{{Incomplete}}
<pageby nominor="false" comments="false"/>
<!-- <pageby nominor="false" comments="false"/> -->
== Definition ==
== Definition ==


This page is a resource page on social science research methodology.
This page is a resource page on social science research methodology with a special focus on approaches and methods used in various research types in educational technology.
 
See also: [[Methodology tutorial]] (a crash course with several modules).


== Research methodology in educational technology ==
== Research methodology in educational technology ==
Line 12: Line 14:


* [http://www.gsu.edu/~wwwitr/docs/leaders/index.html What We Know about Research in Instructional Technology: Interviews with Research Leaders] by Marshall G. Jones et al. presentation at the annual conference of the Association for Educational Communications and Technology. St. Louis, MO. February, 1998.
* [http://www.gsu.edu/~wwwitr/docs/leaders/index.html What We Know about Research in Instructional Technology: Interviews with Research Leaders] by Marshall G. Jones et al. presentation at the annual conference of the Association for Educational Communications and Technology. St. Louis, MO. February, 1998.
* [http://aect.site-ym.com/?page=handbook_of_research Handbook of Research For Educational Communications and Technology] is '''not''' primarily an introduction to research methods, but it does include 8 chapters on methods). In addition, it indirectly demonstrates how research methods are used in Educational Technology research. Edited by J. Michael Spector, M. David Merrill, Jan Elen, and M.J. Bishop, Fourth edition, ISBN 978-1-4614-3184-8, 1005 pages. You can buy this book, but if you [http://www.aect.org/join/ become a member of AECT], it is free.


== Tutorials ==
== Tutorials ==
So far, we don't have a very complete inventory. In particular, good tutorials for qualitative methods are missing...


=== Literature and Bibliography ===
=== Literature and Bibliography ===
Line 23: Line 28:
* Bill Trochim's nice [http://www.socialresearchmethods.net/kb/index.htm Knowledge Base]. This web-based text-book is a good place to start for quantitative research (including statistics)
* Bill Trochim's nice [http://www.socialresearchmethods.net/kb/index.htm Knowledge Base]. This web-based text-book is a good place to start for quantitative research (including statistics)
* [http://allpsych.com/researchmethods/index.html Research Methods], by Christopher L. Heffner. This ten chapter research methods text is written for both undergraduate and graduate students in education, psychology, and the social sciences. It focuses on the basics of research design and the critical analysis of professional research in the social sciences from developing a theory, selecting subjects, and testing subjects to performing statistical analysis and writing the research report.
* [http://allpsych.com/researchmethods/index.html Research Methods], by Christopher L. Heffner. This ten chapter research methods text is written for both undergraduate and graduate students in education, psychology, and the social sciences. It focuses on the basics of research design and the critical analysis of professional research in the social sciences from developing a theory, selecting subjects, and testing subjects to performing statistical analysis and writing the research report.
* [http://tecfa.unige.ch/guides/methodo/edu-tech/ Research Design for Educational Technologists], slides by [[User:Daniel K. Schneider|Daniel K. Schneider]] (I made these in one week and never edited them again, probably usable but not great. Hit ctrl-l to project on a screen).
* Shields, Patricia and Hassan Tajalli. 2006. Intermediate Theory: The Missing Link to successful Student Scholarship. Journal of Public Affairs Education. Vol. 12, No. 3: 313-334. [http://ecommons.txstate.edu/polsfacp/39/ PDF reprint]
* Randolph, Justus J. (2007). Multidisciplinary Methods in Educational Technology Research and Development, HAMK Press, [http://www.archive.org/details/MultidisciplinaryMethodsInEducationalTechnologyResearchAndDevelopment HTML / PDF]. This is the only book that specifically focuses on educational technology, and it's '''free'''!
* [[Methodology tutorial]] (our own crash course with several modules)
* [http://sourceforge.net/projects/itposter/files/ Research Methods Poster] (Gregor Polancic, 2007, made for IT research, but also suitable for social science research).
* [http://benhur.teluq.ca/ST/sciences/sci1013/index.htm Introduction aux méthodes de la recherche scientifique] Teluq University.


See also the [[#Books|books]] section. There exist good introductory books !
See also the [[#Books|books]] section. There exist good introductory books !
=== Writing ===
* [http://www.proof-reading-service.com/guide/ Guide to Academic and Scientific Publication: How To Get Your Writing Published in Scholarly Journals]. Made by a commercial proof reading server. Can only be read online.


=== Statistics ===
=== Statistics ===
Line 35: Line 48:
* [http://davidmlane.com/hyperstat/index.html HyperStat Online Textbook] by David M. Lane at Rice University. Centered on Anova and testing. Look at its [http://davidmlane.com/hyperstat/index.html#humor humor links] to take a break.
* [http://davidmlane.com/hyperstat/index.html HyperStat Online Textbook] by David M. Lane at Rice University. Centered on Anova and testing. Look at its [http://davidmlane.com/hyperstat/index.html#humor humor links] to take a break.
* [http://onlinestatbook.com/rvls.html  Rice Virtual Lab in Statistics] (related to HyperStat)
* [http://onlinestatbook.com/rvls.html  Rice Virtual Lab in Statistics] (related to HyperStat)
* [http://www2.chass.ncsu.edu/garson/pa765/statnote.htm PA 765 Statnotes: An Online Textbook] by G. David Garson, NC State University. '''Very good Hypertext with many detailed "chapters", not always suitable for total beginners'''. Also makes references to SPSS procedures .
* [http://www2.chass.ncsu.edu/garson/pa765/statnote.htm PA 765 Statnotes: An Online Textbook] by G. David Garson, NC State University. '''No longer available / updated''', replaced by [http://www.statisticalassociates.com/ this]. '''Very good Hypertext with many detailed "chapters", not always suitable for total beginners'''. Also makes references to [[SPSS]] procedures .
* [http://www.statisticalassociates.com/ Statistical Associates] by David Garson et al. Revised version of the above. Either commercial e-books (unfortunately in proprietary Kindle format) or free PDFs upon registration (2 day delay).
* [http://www.statisticshell.com/ Statistics Hell]. Dr. Andy Field's slides and handouts (with some dripping blood). Some of his stuff is really recommended, in particular the introductory texts on factor and cluster analysis.
* [http://en.wikipedia.org/wiki/Statistics Wikipedia Statistics]. The Wikipedia has become a very good resource for some issues and models (2006). But not always for the faint hearted.
* [http://en.wikipedia.org/wiki/Statistics Wikipedia Statistics]. The Wikipedia has become a very good resource for some issues and models (2006). But not always for the faint hearted.
* [http://www.utexas.edu/its/rc/tutorials/ Tutorials - ITS / UTexas]. Tutorials provide a general introduction to various software package including information on how to use statistics. (Amos, SAS, SPSS, etc.)
* [http://www.utexas.edu/its/rc/tutorials/ Tutorials - ITS / UTexas]. Tutorials provide a general introduction to various software package including information on how to use statistics. (Amos, SAS, [[SPSS]], etc.)
* [http://www.cas.lancs.ac.uk/glossary_v1.1/main.html Statistics Glossary], Valerie J. Easton &amp; John McColl, Centre for Applied Statistics, Lancaster University. Good tutorial-like site, incl. Index.
* [http://www.cas.lancs.ac.uk/glossary_v1.1/main.html Statistics Glossary], Valerie J. Easton &amp; John McColl, Centre for Applied Statistics, Lancaster University. Good tutorial-like site, incl. Index.
* [http://www.vts.rdn.ac.uk/tutorial/social-statistics/ Internet For Social Statistics. ] This is a free online course that shows you how to find statistics (and related informations) on the Internet and how to deal with it..
* [http://www.vts.rdn.ac.uk/tutorial/social-statistics/ Internet For Social Statistics. ] This is a free online course that shows you how to find statistics (and related informations) on the Internet and how to deal with it..
* [http://deeplearning4j.org/eigenvector A Beginner’s Guide to Eigenvectors, PCA, Covariance and Entropy], by Skymind, 2015.
* [http://www.smallwaters.com/whitepapers/marketing/ Structural Equation Modelling in Market Research] by the people who made the AMOS SEM package. Good. (SEM is not for beginners)
* [http://www.smallwaters.com/whitepapers/marketing/ Structural Equation Modelling in Market Research] by the people who made the AMOS SEM package. Good. (SEM is not for beginners)
* [http://www.msb.edu/training/statistics/amos/Tutorial-AG.pdf Georgetown AMOS Tutorial] (version 4, Intro to the program and simple multiple regression, suitable for beginners)
* [http://www.msb.edu/training/statistics/amos/Tutorial-AG.pdf Georgetown AMOS Tutorial] (version 4, Intro to the program and simple multiple regression, suitable for beginners)
* [http://www.socialresearchmethods.net/kb/ Research Methods Knowledge Base website],
* [http://www.scs.unr.edu/~richmon4/richmondstats.htm Statistical Consulting & Tutoring Service] (A. Richmond)
* [http://jeromyanglim.blogspot.ch/ Jeromy Anglim's Blog: Psychology and Statistics]
See also the [[SPSS]] entry.
=== Diagrams and charts for choosing a statistical method/test ===
* [http://bama.ua.edu/~jleeper/627/choosestat.html Choosing the Correct Statistical Test]
* [http://www.ats.ucla.edu/stat/mult_pkg/whatstat/default.htm What statistical analysis should I use?] (Idre)
* [https://stats.idre.ucla.edu/other/mult-pkg/whatstat/ Choosing the Correct Statistical Test in SAS, Stata, SPSS and R] (UCLA Guide)
* [https://www.google.ch/search?q=flow+chart+for+selecting+statistical+methods Search decision flow charts for statistics in google images]


=== Qualitative Research ===
=== Qualitative Research ===
Line 47: Line 75:
* [http://www.socresonline.org.uk/3/3/4.html Choosing Qualitative Data Analysis Software: Atlas/ti and Nudist Compared] by Christine Barry, Sociological Research Online, vol. 3, no. 3. Note: this on-line journal has other "quali" articles.
* [http://www.socresonline.org.uk/3/3/4.html Choosing Qualitative Data Analysis Software: Atlas/ti and Nudist Compared] by Christine Barry, Sociological Research Online, vol. 3, no. 3. Note: this on-line journal has other "quali" articles.
* [http://www.socresonline.org.uk/3/3/3.html Hypermedia and Ethnography: Reflections on the Construction of a Research Approach], by Bella Dicks and Bruce Mason, Sociological Research Online, vol. 3, no. 3
* [http://www.socresonline.org.uk/3/3/3.html Hypermedia and Ethnography: Reflections on the Construction of a Research Approach], by Bella Dicks and Bruce Mason, Sociological Research Online, vol. 3, no. 3
* Lombard,  Matthew, Jennifer Snyder-Duch and Cheryl Campanella Bracken (2005). [http://www.temple.edu/sct/mmc/reliability/ Practical Resources for Assessing and Reporting Intercoder Reliability in Content Analysis Research Projects], Webpage, retrieved May 2008
* Eisenhardt, Kathleen M. (1989), [http://www.jstor.org/stable/258557 Building Theories from Case Study Research], The Academy of Management Review, Vol. 14, No. 4 (Oct., 1989), pp. 532-550
* [http://www.is.njit.edu/pubs/delphibook/ The Delphi Method: Techniques and Applications]. online book,  Harold A. Linstone and Murray Turoff, Editors.
* Blandford, Ann (2013). [http://www.interaction-design.org/encyclopedia/semi-structured_qualitative_studies.html Semi-structured qualitative studies]. In: Soegaard, Mads and Dam, Rikke Friis (eds.). "The Encyclopedia of Human-Computer Interaction, 2nd Ed.". Aarhus, Denmark: The Interaction Design Foundation. Available online at http://www.interaction-design.org/encyclopedia/semi-structured_qualitative_studies.html
* Braun, Virginia and Clarke, Victoria (2006) Using thematic analysis in psychology.  Qualitative Research in Psychology, 3 (2).  pp.77-101. ISSN 1478-0887. http://dx.doi.org/10.1191/1478088706qp063oa. Also available from: https://www.researchgate.net/publication/235356393_Using_Thematic_Analysis_in_Psychology [accessed Aug 29, 2017].


=== Network Analysis ===
=== Network Analysis ===


* [http://linkanalysis.wlv.ac.uk/i Link Analysis]<nowiki>: An Information Science Approach" by Mike Thelwall. This site contains extra information related to the book. (webometrics). See also the [http://socscibot.wlv.ac.uk/ SocSciBot3] software that can be used togetehr with the Pajek program
* [http://linkanalysis.wlv.ac.uk/i Link Analysis]: An Information Science Approach" by Mike Thelwall. This site contains extra information related to the book. (webometrics). See also the [http://socscibot.wlv.ac.uk/ SocSciBot3] software that can be used togetehr with the Pajek program
* [http://pajek.imfm.si/doku.php Pajek] is a Program for Large Network Analysis (Wiki site)
* [http://pajek.imfm.si/doku.php Pajek] is a Program for Large Network Analysis (Wiki site)
=== Big web data ===
* [https://communitydata.cc/social-media-chapter/ Software and data for "A Computational Analysis of Social Media Scholarship"] by Jeremy Foote, Aaron Shaw, Benjamin Mako Hill


=== Design methodology ===
=== Design methodology ===
Line 60: Line 97:
'''Educational design methodology is not indexed in this page''', see [[instructional design method]] and its various incarnations, e.g. [[Instructional systems design]]
'''Educational design methodology is not indexed in this page''', see [[instructional design method]] and its various incarnations, e.g. [[Instructional systems design]]


See also: [[design science]] and other articles targeted with [[Category:Design methodologies|design methodologies]]
See also: [[design science]] and other articles targeted with [[:Category:Design methodologies|design methodologies]]


=== Software Development ===
== Software ==


* [http://www.computer.org/computer/homepage/misc/Boehm/ A Spiral Model of Software Development and Enhancement], arry W. Boehm, TRW Defense Systems Group
Some day, I may add more things. In my group, we use mostly Atlas for qualitative and [[SPSS]] for quantitative analysis. Some QUAL software is described in [[Computer assisted qualitative research analysis software]] and [[content analysis]]. Also, follow-up resources in the [[#Methodology_Links|links]] section.


== Software ==
* [http://maltman.hmdc.harvard.edu/socsci.shtml The Impoverished Social Scientist's Guide to Free Statistical Software and Resources] by Micah Altman. This is probably the best list of free quantitative software on the Internet
* [http://www.researchware.com/index.html ResearchWare] has a reduced free versions of HyperResearch (Quali tool)


(some day, I may add more things. In my group, we use mostly Atlas for qualitative and SPSS for quantitative analysis ... for the moment please see the links below)
; Free statistics software
* [[R]]
* [http://www.gpower.hhu.de/en.html G*Power: Statistical Power Analyses for Windows and Mac]


; Other stuff
* [http://www.analytictech.com/netdraw.htm NetDraw Network Visualization]. Free program for visualizing 1-mode and 2-mode social network data (made by Steve Borgatti and Roberta Chase, Analytic Technologies)
* [http://www.analytictech.com/netdraw.htm NetDraw Network Visualization]. Free program for visualizing 1-mode and 2-mode social network data (made by Steve Borgatti and Roberta Chase, Analytic Technologies)
* Microsoft Excel: Avoid whenver you can !: However if you really must (e.g. if you don't have cash for SPSS or you if you are too illiterate to download a free stats program), then search for "Using Excel for survey analysis". You then may find resources like:
* [http://www.indiana.edu/~socpsy/ESA/ Ethno], is an on-line Java program that helps you analyze sequential events.
* Microsoft Excel: Avoid whenver you can !: However if you really must (e.g. if you don't have cash for [[SPSS]] or you if you are too illiterate to download a free stats program), then search for "Using Excel for survey analysis". You then may find resources like:
** [http://www.usp.edu/learningmodules/excel_data_analysis_tools.htm Using the Data Analysis Tool in Excel]
** [http://www.usp.edu/learningmodules/excel_data_analysis_tools.htm Using the Data Analysis Tool in Excel]


== Books ==
; Online tools
* [http://psych-wextor.unizh.ch/wextor/en/index.php WEXTOR] is a Web-based tool that lets you quickly design and visualize laboratory experiments and Web experiments in a guided step-by-step process.
* [https://www.statstodo.com/index.php StatsToDo] provides over 200 pages of statistical programs and explanations for clinical research and quality control.
 
== Books and articles ==


=== General ===
=== General ===


These books should be suitable for beginners, e.g. MA and PhD Students. But before buying any, you should read customer reviews in online bookstores or other sources. And of course, you shouldn't need more than two of these. ''Leedy and Ormrod'' is probably one of the best books to start with.
These books and articles should be suitable for beginners, e.g. MA and PhD Students. Before buying any book, you should read customer reviews in online bookstores or other sources. And of course, you shouldn't need more than two of these. ''Leedy and Ormrod'' is probably one of the best books to start with.


* Bell, Judith (2005). Doing Your Research Project: A Guide for First-Time Researchers in Education and Social Science, 4th edition, Buckingham: Open University Press, ISBN 0335215041
* Bell, Judith (2005). Doing Your Research Project: A Guide for First-Time Researchers in Education and Social Science, 4th edition, Buckingham: Open University Press, ISBN 0335215041
Line 94: Line 140:
* Newman, Lawrence (2003). Basics of Social Research: Quantitative and Qualitative Approaches. Allyn & Bacon, ISBN 0205355781
* Newman, Lawrence (2003). Basics of Social Research: Quantitative and Qualitative Approaches. Allyn & Bacon, ISBN 0205355781


=== About dissertations ===
=== Dissertations / writing journal papers ===


* Bolker, Joan (1998). Writing Your Dissertation in Fifteen Minutes a Day: A Guide to Starting, Revising, and Finishing, Holt Paperbacks, ISBN 080504891X
* Bolker, Joan (1998). Writing Your Dissertation in Fifteen Minutes a Day: A Guide to Starting, Revising, and Finishing, Holt Paperbacks, ISBN 080504891X
Line 109: Line 155:
* Cook, Thomas, K. and Campbell, Donald T. (1979). Quasi-Experimentation: Design and Analysis Issues for Field Settings, Houghton Mifflin Company, ISBN-10 0395307902
* Cook, Thomas, K. and Campbell, Donald T. (1979). Quasi-Experimentation: Design and Analysis Issues for Field Settings, Houghton Mifflin Company, ISBN-10 0395307902


* Campbell, Donald T. and Stanley, Julian (1963). Experimental And Quasi-experimental Designs For Research, ISBN 0395307872. (Very old, but still relevant)
* Campbell, Donald T. and Stanley, Julian (1963). Experimental And Quasi-experimental Designs For Research, Boston: Houghton Mifflin. ISBN 0395307872. (Very old, but still relevant)


; Experimental research
; Experimental research
Line 118: Line 164:


* Fowler, Floyd, J. (2001) Survey Research Methods, Sage Publications, ISBN 0761921915
* Fowler, Floyd, J. (2001) Survey Research Methods, Sage Publications, ISBN 0761921915
* DeVellis, R. F. (2003). Scale development: theory and applications. Applied social research methods series Volume 26. Thousand oaks, London, Delhi: Sage Publications.
; Statistics
* Field, A. P. (2005). Discovering statistics using SPSS (second edition). London: Sage publications. ISBN 0-7619-4452-4. (Good introduction to statistics book for beginners, and help with [[SPSS]] too).
* Hinton, D. P. R. (2004). Statistics Explained: A Guide for Social Science Students (2nd ed.). Routledge. ISBN 0415332850


; Qualitative research
; Qualitative research
Line 124: Line 178:


* Miles, Matthew B. and Michael Huberman. (1994) ''Qualitative Data Analysis: An Expanded Sourcebook'', Sage Publications. ISBN 0803955405
* Miles, Matthew B. and Michael Huberman. (1994) ''Qualitative Data Analysis: An Expanded Sourcebook'', Sage Publications. ISBN 0803955405
* Dey, I. (1993). Qualitative Data Analysis. Routledge, London.
* Marshall, C. &amp; Rossman, G. B. (1995) , Designing Qualitative Research, second edition, Sage, London
* Hoepfl, Marie C. (1997). Choosing Qualitative Research: A Primer for Technology Education Researchers, ''Journal of technoloy education'', Volume 9, Number 1. [http://scholar.lib.vt.edu/ejournals/JTE/v9n1/hoepfl.html HTML].
; Case study research
* Merriam, Sharan B. (1997) Qualitative Research and Case Study Applications in Education, Jossey-Bass, ISBN 0787910090
* Stake, Robert Earl (1995). The Art Of Case Study Research, Sage Publications, ISBN 080395767X
* Yin, R.K. (2002) Case Study Research - Design And Methods. Third edition. Sage Publications, ISBN 0761925538 (first edition was in 1984).
; Mixed Methods
* Johnson R.B., Onwuegbuzie A.J., Turner L.A. (2007). ''Journal of Mixed Methods Research'', April 2007 vol. 1 no. 2 112-133. [http://mmr.sagepub.com/content/1/2/112.short Abstract/PDF]
* Johnson R.B. Comments on Howe: Toward a more inclusive "scientific research in education", (2009) Educational Researcher, 38 (6), pp. 449-457. [http://edr.sagepub.com/content/38/6/449.abstract Abstract].
; Applied computer science
* Pertti Järvinen: On Research Methods. Tampere: Opinpajan Kirja, ISBN 952-99233-1-7 . (This seems to be the only useful general methdology book related to design-oriented technology research. Very dense reading, but worth to buy, directly from the [http://www.uta.fi/taju this bookstore] or from [http://granum.uta.fi/english/kirjanTiedot.php?tuote_id=2538 Granum] (tested by [[User:DSchneider|me]]).
; Data science
* Ani Adhikari and John DeNero, [http://www.inferentialthinking.com/index.html Computational and Inferential Thinking], The Foundations of Data Science, This is the textbook for the Foundations of Data Science class at UC Berkeley. Also at https://www.gitbook.com/book/ds8/textbook/details.


=== To sort out ===
=== To sort out ===
Line 129: Line 207:
* Fraenkel, J., & Wallen, N. (2006). How to Design and Evaluate Research in Education with PowerWeb (6th ed.) New York: McGraw-Hill.  
* Fraenkel, J., & Wallen, N. (2006). How to Design and Evaluate Research in Education with PowerWeb (6th ed.) New York: McGraw-Hill.  


* Steiner, E. (1988). Methodology of Theory Building. Sydney: Educology Research Associates.  
* Steiner, E. (1988). Methodology of Theory Building. Sydney: Educology Research Associates.


== Methodology Links ==
== Methodology Links ==
Line 147: Line 225:
* [http://www2.chass.ncsu.edu/garson/pa765/links.htm PA 765 Research Methodology Links] by G. David Garson, NC State University
* [http://www2.chass.ncsu.edu/garson/pa765/links.htm PA 765 Research Methodology Links] by G. David Garson, NC State University
* [http://web.pdx.edu/~dbls/HowtoWriteLiteratureReview.htm Selected Links to Resources on Writing a Literature Review ]
* [http://web.pdx.edu/~dbls/HowtoWriteLiteratureReview.htm Selected Links to Resources on Writing a Literature Review ]
* [http://en.wikipedia.org/wiki/Category:Scientific_method List of Wikipedia articles on scientific method]
* [http://www.brainpickings.org/index.php/2014/01/03/baloney-detection-kit-carl-sagan/ The Baloney Detection Kit: Carl Sagan’s Rules for Bullshit-Busting and Critical Thinking] by Maria Popova, blog post, Jan. 2014.
* [http://cogsci.stackexchange.com/ Cognitive Sciences Stack Exchange] is a question and answer site
* [http://www.methodspace.com/ MethodSpace] - Brought to you by SAGE Publishing
* [https://sites.google.com/site/gsocialchange/home Free Resources for Evaluation and Social Research Methods] (by [https://www.linkedin.com/in/gene-shackman-5032b660 Gene Shackman Gene Shackman Director at The Global Social Change Research Project].


=== Qualitative Research ===
=== Qualitative Research ===
Line 179: Line 262:
* [http://www.irn.pdx.edu/~kerlinb/quant.corner.html The Quant Corner] INDEX by Bobbi Kerlin
* [http://www.irn.pdx.edu/~kerlinb/quant.corner.html The Quant Corner] INDEX by Bobbi Kerlin
* [http://noppa5.pc.helsinki.fi/links.html A few links related to Statistics Education] by Juha Puranen. Large list of some useful links related to Statistics Education - Online Statistical teaching material, courses , handouts, exercises, articles, datasets. This is the best index I am aware of.
* [http://noppa5.pc.helsinki.fi/links.html A few links related to Statistics Education] by Juha Puranen. Large list of some useful links related to Statistics Education - Online Statistical teaching material, courses , handouts, exercises, articles, datasets. This is the best index I am aware of.
* [http://en.wikiversity.org/wiki/Questionnaire Questionnaire] (Wikiversity)
=== Experimental research ===
* [http://www.wexlist.net// The web experiment list], University of Deusto. Intended to be the world's most comprehensive archive of current and past psychological Web experiments. So these are good examples.


=== Associations, Journals, Forums on-line ===
=== Associations, Journals, Forums on-line ===
Line 186: Line 274:
* [http://itech1.coe.uga.edu/itforum/ ITFORUM] A listserv for the Instructional Tehcnology community. Quite a lot of discussion on research problems. Also includes discussions on special [http://it.coe.uga.edu/itforum/Previous.html topics]
* [http://itech1.coe.uga.edu/itforum/ ITFORUM] A listserv for the Instructional Tehcnology community. Quite a lot of discussion on research problems. Also includes discussions on special [http://it.coe.uga.edu/itforum/Previous.html topics]


=== Data and Question Archives ===
=== Data and Question Archives and repositories ===


* [[learning surveys]] and [[Usability and user experience surveys]] (small inventories of survey instruments)
* [http://maltman.hmdc.harvard.edu/data.shtml The Impoverished Social Scientist's Guide to Data Resources] by Micah Altman. A good starting point for major data resources as well as many international and US databases.
* [http://www.psr.keele.ac.uk/data.htm Data Archives] List at Keele/UK
* [http://www.psr.keele.ac.uk/data.htm Data Archives] List at Keele/UK
* [http://qb.soc.surrey.ac.uk/ The Question Bank], Social surveys online, sponsored by UK Economic and Social Research Council
* [http://qb.soc.surrey.ac.uk/ The Question Bank], Social surveys online, sponsored by UK Economic and Social Research Council
* [http://www.sidos.ch/index.html SIDOS] Swiss information and data archive service for the social sciences
* [http://www.sidos.ch/index.html SIDOS] Swiss information and data archive service for the social sciences
* [http://www.selects.ch/ Swiss electoral studies] (related to SIDOS)
* [http://www.selects.ch/ Swiss electoral studies] (related to SIDOS)
* [http://pewglobal.org/category/data-sets/ Pew Research Center’s Global Attitudes Project] conducts public opinion surveys around the world on a broad array of subjects ranging from people’s assessments of their own lives to their views about the current state of the world and important issues of the day. After 2-3 years, datasets are made public.
* [http://www.learnlab.org/technologies/datashop/ DataShop], a data repository and analysis service for the learning science community
Other sorts of data:
* [http://www.guardian.co.uk/data-store Data Store]. All sorts of data (published by the Guardian newpaper). Some available through a Google spreadsheet.
* [http://www.delicious.com/smfrogers Simon Rogers's Delicious Bookmarks]. A few hundred bookmarks on data that are of interest to journalists and others ...


== Finding information on the Internet ==
== Finding information on the Internet ==

Latest revision as of 10:53, 24 January 2018

Definition

This page is a resource page on social science research methodology with a special focus on approaches and methods used in various research types in educational technology.

See also: Methodology tutorial (a crash course with several modules).

Research methodology in educational technology

Educational technology uses the whole palette of social science methodology. Very few approaches originated in our field. One recent example is design-based research (DBR). But even DBR uses methods and techniques developed in other contexts. Of course edutech research does contribute to the evolution of various tools, e.g contributes to the methodology of log file analysis, dialogue and discourse analysis, observation of human-computer interaction, development of survey scales, etc.

See also: Educational technology research approaches for a discussion on what is considered to be good research.

  • Handbook of Research For Educational Communications and Technology is not primarily an introduction to research methods, but it does include 8 chapters on methods). In addition, it indirectly demonstrates how research methods are used in Educational Technology research. Edited by J. Michael Spector, M. David Merrill, Jan Elen, and M.J. Bishop, Fourth edition, ISBN 978-1-4614-3184-8, 1005 pages. You can buy this book, but if you become a member of AECT, it is free.

Tutorials

So far, we don't have a very complete inventory. In particular, good tutorials for qualitative methods are missing...

Literature and Bibliography

See literature review and citation articles

General introduction to research methodology

  • Bill Trochim's nice Knowledge Base. This web-based text-book is a good place to start for quantitative research (including statistics)
  • Research Methods, by Christopher L. Heffner. This ten chapter research methods text is written for both undergraduate and graduate students in education, psychology, and the social sciences. It focuses on the basics of research design and the critical analysis of professional research in the social sciences from developing a theory, selecting subjects, and testing subjects to performing statistical analysis and writing the research report.
  • Shields, Patricia and Hassan Tajalli. 2006. Intermediate Theory: The Missing Link to successful Student Scholarship. Journal of Public Affairs Education. Vol. 12, No. 3: 313-334. PDF reprint
  • Randolph, Justus J. (2007). Multidisciplinary Methods in Educational Technology Research and Development, HAMK Press, HTML / PDF. This is the only book that specifically focuses on educational technology, and it's free!
  • Methodology tutorial (our own crash course with several modules)
  • Research Methods Poster (Gregor Polancic, 2007, made for IT research, but also suitable for social science research).
  • Introduction aux méthodes de la recherche scientifique Teluq University.

See also the books section. There exist good introductory books !

Writing

Statistics

There are loads of tutorials on the web. If you are not happy with this little choice, look this for example.

See also the SPSS entry.

Diagrams and charts for choosing a statistical method/test

Qualitative Research

Network Analysis

  • Link Analysis: An Information Science Approach" by Mike Thelwall. This site contains extra information related to the book. (webometrics). See also the SocSciBot3 software that can be used togetehr with the Pajek program
  • Pajek is a Program for Large Network Analysis (Wiki site)

Big web data

Design methodology

Educational design methodology is not indexed in this page, see instructional design method and its various incarnations, e.g. Instructional systems design

See also: design science and other articles targeted with design methodologies

Software

Some day, I may add more things. In my group, we use mostly Atlas for qualitative and SPSS for quantitative analysis. Some QUAL software is described in Computer assisted qualitative research analysis software and content analysis. Also, follow-up resources in the links section.

Free statistics software
Other stuff
  • NetDraw Network Visualization. Free program for visualizing 1-mode and 2-mode social network data (made by Steve Borgatti and Roberta Chase, Analytic Technologies)
  • Ethno, is an on-line Java program that helps you analyze sequential events.
  • Microsoft Excel: Avoid whenver you can !: However if you really must (e.g. if you don't have cash for SPSS or you if you are too illiterate to download a free stats program), then search for "Using Excel for survey analysis". You then may find resources like:
Online tools
  • WEXTOR is a Web-based tool that lets you quickly design and visualize laboratory experiments and Web experiments in a guided step-by-step process.
  • StatsToDo provides over 200 pages of statistical programs and explanations for clinical research and quality control.

Books and articles

General

These books and articles should be suitable for beginners, e.g. MA and PhD Students. Before buying any book, you should read customer reviews in online bookstores or other sources. And of course, you shouldn't need more than two of these. Leedy and Ormrod is probably one of the best books to start with.

  • Bell, Judith (2005). Doing Your Research Project: A Guide for First-Time Researchers in Education and Social Science, 4th edition, Buckingham: Open University Press, ISBN 0335215041
  • Cohen, Louis , Lawrence Manion , Keith Morrison (2007). Research Methods in Education, 6th ed. Routledge, ISBN 0415368782.
  • Creswell, John W. (2002). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches (2nd Edition), Sage Publications, ISBN 0761924426
  • Creswell, John W. (2004). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, Prentice Hall; 3rd edition. ISBN 0136135501 - Companion web site
  • Leedy, P. D., & Ormrod, J. E. (2005). Practical research: Planning and design (8th ed.). Upper Saddle River, NJ: Pearson Education. ISBN 0131108956
  • Newman, Lawrence (2005). Social Research Methods: Qualitative and Quantitative Approaches, 6th edition. Allyn & Bacon, ISBN 0205457932
  • Newman, Lawrence (2003). Basics of Social Research: Quantitative and Qualitative Approaches. Allyn & Bacon, ISBN 0205355781

Dissertations / writing journal papers

  • Bolker, Joan (1998). Writing Your Dissertation in Fifteen Minutes a Day: A Guide to Starting, Revising, and Finishing, Holt Paperbacks, ISBN 080504891X
  • Peters (1997) Getting What You Came For: A Smart Student's Guide to Earning a Masters or Ph.D.

See also literature review

Specialized

(This list could be much longer of course)

Quasi-experimental research
  • Cook, Thomas, K. and Campbell, Donald T. (1979). Quasi-Experimentation: Design and Analysis Issues for Field Settings, Houghton Mifflin Company, ISBN-10 0395307902
  • Campbell, Donald T. and Stanley, Julian (1963). Experimental And Quasi-experimental Designs For Research, Boston: Houghton Mifflin. ISBN 0395307872. (Very old, but still relevant)
Experimental research
  • Box, George E. P.; William G. Hunter; J. Stuart Hunter and William Gordon Hunter (2005). Statistics for Experimenters: Design, Innovation, and Discovery, 2nd edition. John Wiley & Sons, ISBN 0471718130. (Rather difficult reading).
Survey research
  • Fowler, Floyd, J. (2001) Survey Research Methods, Sage Publications, ISBN 0761921915
  • DeVellis, R. F. (2003). Scale development: theory and applications. Applied social research methods series Volume 26. Thousand oaks, London, Delhi: Sage Publications.
Statistics
  • Field, A. P. (2005). Discovering statistics using SPSS (second edition). London: Sage publications. ISBN 0-7619-4452-4. (Good introduction to statistics book for beginners, and help with SPSS too).
  • Hinton, D. P. R. (2004). Statistics Explained: A Guide for Social Science Students (2nd ed.). Routledge. ISBN 0415332850
Qualitative research
  • Denzin, Norman K. and Yvonna S. Lincoln (eds) (). The SAGE Handbook of Qualitative Research, Sage Publications. ISBN 0761927573
  • Miles, Matthew B. and Michael Huberman. (1994) Qualitative Data Analysis: An Expanded Sourcebook, Sage Publications. ISBN 0803955405
  • Dey, I. (1993). Qualitative Data Analysis. Routledge, London.
  • Marshall, C. & Rossman, G. B. (1995) , Designing Qualitative Research, second edition, Sage, London
  • Hoepfl, Marie C. (1997). Choosing Qualitative Research: A Primer for Technology Education Researchers, Journal of technoloy education, Volume 9, Number 1. HTML.
Case study research
  • Merriam, Sharan B. (1997) Qualitative Research and Case Study Applications in Education, Jossey-Bass, ISBN 0787910090
  • Stake, Robert Earl (1995). The Art Of Case Study Research, Sage Publications, ISBN 080395767X
  • Yin, R.K. (2002) Case Study Research - Design And Methods. Third edition. Sage Publications, ISBN 0761925538 (first edition was in 1984).
Mixed Methods
  • Johnson R.B., Onwuegbuzie A.J., Turner L.A. (2007). Journal of Mixed Methods Research, April 2007 vol. 1 no. 2 112-133. Abstract/PDF
  • Johnson R.B. Comments on Howe: Toward a more inclusive "scientific research in education", (2009) Educational Researcher, 38 (6), pp. 449-457. Abstract.
Applied computer science
  • Pertti Järvinen: On Research Methods. Tampere: Opinpajan Kirja, ISBN 952-99233-1-7 . (This seems to be the only useful general methdology book related to design-oriented technology research. Very dense reading, but worth to buy, directly from the this bookstore or from Granum (tested by me).
Data science

To sort out

  • Fraenkel, J., & Wallen, N. (2006). How to Design and Evaluate Research in Education with PowerWeb (6th ed.) New York: McGraw-Hill.
  • Steiner, E. (1988). Methodology of Theory Building. Sydney: Educology Research Associates.

Methodology Links

(dig around and you will find it)

More General

Qualitative Research

(both formal/structured and unformal)

  • QualPage by Judy Norris. Very good site.

Network Analysis

Quantitative Research

  • Statlib, datasets, scripts for various packages, routines for programmers who want to hack it their own way, etc.
  • Methods in Behavioral Research by Paul C. Cozby. Good structured links for experimental research (according to chapters of his book)
  • The Quant Corner INDEX by Bobbi Kerlin
  • A few links related to Statistics Education by Juha Puranen. Large list of some useful links related to Statistics Education - Online Statistical teaching material, courses , handouts, exercises, articles, datasets. This is the best index I am aware of.
  • Questionnaire (Wikiversity)

Experimental research

  • The web experiment list, University of Deusto. Intended to be the world's most comprehensive archive of current and past psychological Web experiments. So these are good examples.

Associations, Journals, Forums on-line

Data and Question Archives and repositories

Other sorts of data:

  • Data Store. All sorts of data (published by the Guardian newpaper). Some available through a Google spreadsheet.
  • Simon Rogers's Delicious Bookmarks. A few hundred bookmarks on data that are of interest to journalists and others ...

Finding information on the Internet

It is increasingly easy to find academic materials on the Internet. However, for many resources you (or your institution) has to pay.

See also: literature review

Open access

Commercial offerings

There are many, here are just a few: