Audience response systems as a data collection method in organizational research

home > archives > 15/1 > Audience response systems as a data coll

Matthew W McCarter
College of Business, University of Illinois at Urbana-Champaign, Champaign IL, United States of America

Arran Caza
College of Business, University of Illinois at Urbana-Champaign, Champaign IL, United States of America

PP: 122

Abstract

Audience responses systems are electronic devices allowing audience interaction and they are increasingly being used in educational and business settings to enhance various pedagogical and practical processes.

This paper discusses how ARS technology may be used as a method of collecting data for research purposes. Specifically, this paper demonstrates ARS technology's potential utility by duplicating findings from two organisational studies, it discusses how ARS technology may be used to address three prevalent data collection problems, and it suggests how ARS technology may provide scholars with increased access to certain organisational settings, as well as greater integration between research and service activities.

| More

Keywords

audience response system, personal response system, audience response technology, data collection techniques, data collection technology, organizational research methods

Article Text

Data collection is an important element of any research methodology. As scholars strive to understand behavioural phenomena in organisations, the need for data collection methods that are convenient to both scholars and respondents and which may be used to gather data from a wide variety of organisational settings becomes important. This is especially true given evidence suggesting that individuals are becoming less inclined to participate in organisational research (Bryman 2000). The purpose of this paper is to discuss how audience response system (ARS) technology may be used to collect data for research purposes.

This paper is in four parts. First, we review the literature on audience response systems and discuss how they are traditionally used. Second, we duplicate findings from two organisational studies to demonstrate how ARS technology may be used to test theory. Third, we discuss how ARS technology may be used to address three prevalent data collection problems. Fourth, we discuss other issues related to using an ARS for research, including limitations and benefits, such as increased access to certain organisational settings and a greater integration between research and service activities.

...continues...

View references

References

Armstrong JS and Sperry T (1994) Business school prestige: Research versus teaching, Interfaces 24: 13-43.

Barber M and Njus D (2007) Clicker evolution: Seeking intelligent design, CBE-Life Science Education 6: 1-20.

Boyer EL (1990) Scholarship reconsidered: Priorities of the professoriate. Carnegie Foundation for the Advancement of Teaching, Princeton NJ.

Bryman A (2000) Research methods and organization studies. Routledge, London UK.

Bunz U (2005) Using scantron versus an audience response system for survey research: Does methodology matter when measuring computer-mediated communication competence? Computers & Human Behaviour 21: 343-359.

Byrd GG, Coleman S and Werneth C (2004) Exploring the universe together: Cooperative Quizzes with and without a Classroom Performance System in Astronomy 101, Astronomy Education Review 3: Retrieved 10 October 2007, from http://aer.noao.edu/cgibin/article.pl?id=91%3E%3Cimg%20src=.

Caldwell J (2006) Clickers in the large classroom: Current research and best-practice tips, CBE-Life Science Education 6: 9-20.

Cohen J (1988) Statistical power analysis for the behavioural sciences. Erlbaum, Hillsdale NJ.

Czaja S, Sharit J, Nair S and Rubert M (1998) Understanding sources of user variability in computer-based data entry performance, Behaviour & Information Technology 17: 282-293.

D'Arcy CJ, Eastburn DM and Mullally K (2007) Effective use of a personal response system in a general education plant pathology class, Planet Earth Instructor. Retrieved 10 October 2007, from http://www.apsnet.org/education/InstructorCommunication/TeachingArticles/PRSPathology/default.htm.

Diekmann A (1985) Volunteer's dilemma, Journal of Conflict Resolution 29: 605-610.

Dillmam A (2007) Mail and internet surveys: The tailored design method. Wiley, Hoboken NJ.

Draper S, Cargill J and Cutts Q (2002) Electronic enhanced classroom interaction, Australian Journal of Education Technology 18: 13-23.

Duncan D (2006) Clickers: A new teaching aid with exceptional promise, Astronomy Education Review 5: 70-88.

Eden D (2003) Critical management studies and the academy of management journal: Challenge and counterchallenge, Academy of Management Journal 46: 390-394.

Eid M and Diener E (2005) Handbook of multi-method measurement in psychology. American Psychological Association, Washington DC.

Feng S (2004) Detecting errors in the current population survey: a matching approach, Economics Letters 82: 189-194.

Fies C and Marshall J (2006) Classroom response systems: A review of the literature, Journal of Science Education & Technology 15: 101-109.

Fox KJ and Milbourne R (1999) What determines research output of academic economists? Economic Record 75: 256-267.

Franzen A (1995) Group size and one-shot collective action, Rationality & Society 7: 183-200.

Gamito E, Burhansstipanov L, Krebs L, Bemis L and Bradley A (2005) The use of an electronic audience response system for data collection, Journal of Cancer Education 20: 80-86.

Hansen J and Hill N (1998) Control and audit of electronic data interchange, MIS Quarterly 13: 402-413.

Hatch S (2003) ARS systems: creativity and planning required, Corporate Meetings & Incentives 22: 35-36.

Hattie J and Marsh HW (1996) The relationship between research and teaching: A meta-analysis, Review of Educational Research 66: 507-542.

Heckathorn D (1996) The dynamics and dilemmas of collective action, American Sociological Review 61: 250-277.

Homme J, Asay G and Morgenstern B (2004) Utilisation of an audience response system, Medical Education 38: 575.

James C (1990) Evaluating the cost effectiveness of hand-held computer technology, Public Productivity & Management Review 13: 201-213.

Kerr S (1975) On the folly of rewarding A, while hoping for B, Academy of Management Journal 18: 769-783.

Krantz M (2004) Audience response system = marketing tool, Meeting News 28: 5.

Liebrand W (1983) A classification of social dilemma games, Simulation & Games 14: 123-138.

Magolda MB (1999) Creating contexts for learning and self-authorship. Vanderbilt University Press, Nashville TN.

Miller R, Ashar B and Getz K (2003) Evaluation of an audience response system for continuing education of health professionals, Journal of Continuing Education in the Health Professions 23: 109-116.

Murnighan JK, Kim JW and Metzger AR (1993) The volunteer dilemma, Administrative Science Quarterly 38: 515-538.

Murphy FH (1994) Don't let shallow reporters set the agenda: A comment on Armstrong & Sperry (1994) Interfaces 24: 25-26.

Olson M (1965) The logic of collective action: Public goods and the theory of groups. Harvard University Press, Cambridge MA.

Pedhazur E and Schmelkin L (1991) Measurement, design, and analysis: An integrated approach. Erlbaum, Hillsdale NJ.

Rogelberg S, Church A, Waclawski J and Stanton J (2002) Organizational survey research. In Rogelberg S (ed) Handbook of Research Methods in Industrial and Organizational Psychology, pp.141-161, Blackwell Publishing, Boston MA.

Rosenthal R (1994) Science and ethics in conducting, analyzing, and reporting psychological research, Psychological Science 5: 127-134.

Scandura T and Williams E (2000) Research methodology in management: Current practices, trends, and implications for future research, Academy of Management Journal 43: 1248-1264.

Sen A (1985) Goals, commitment, and identity, Journal of Law Economics & Organizations 1: 341-355.

Siegel S (1956) Nonparametric statistics for the behavioural sciences. McGraw-Hill, New York.

Shadish WR, Cook TD and Campbell DT (2002) Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin, Boston MA.

Smith W (1967) Accuracy of manual entries in data collection devices, Journal of Applied Psychology 51: 362-368.

Sproull LS (1986) Using electronic mail for data collection in organizational research, Academy of Management Journal 29: 159-169.

Starbuck WH (2004) Why I stopped trying to understand the real world, Organization Studies 27: 1233-1254.

Stone-Romero E (2002). The relative validity and usefulness of various empirical research designs, in Rogelberg S (ed) Handbook of Research Methods in Industrial and Organizational Psychology, pp.77-98, Blackwell Publishing, Boston MA.

Task Force on Teaching and Career Development (2007) A compact to enhance teaching and learning at Harvard. Harvard University Press, Cambridge MA.

Training and Development (2006) Improving business decisions and strategic planning, 60: 63-65.

Webb E, Campbell D, Schwartz R and Sechrest L (2000) Unobtrusive measures: Revised edition. Sage, London.

Navigate: Archives | Contents | Top of page