Authors
Zsuzsanna I. Abrams is an Assistant Professor in the Department of Germanic Studies at the University of Texas, Austin, Texas. Correspondence concerning this article can be directed to zsabrams@mail.utexas.edu
Abstract: A primary objective of graduate education, and often promoted by peer collaboration tasks, is the development of critical thinking skills. The present study compares how graduate students enrolled in a qualitative research design course in applied linguistics utilized asynchronous computer-mediated communication (ACMC) and face-to-face interactions to critique field-specific research, to design and conduct their own research projects, and to engage in professional discourse in and out of class. The analyses reveal that 1) it was impossible to measure the development of critical thinking skills within one semester, and 2) rather than ACMC serving as a spring-board for such development prior to or in collaboration with classroom exchanges, ACMC and face-to-face interactions served different social and intellectual purposes in the process of practicing critical thinking skills. While face-to-face exchanges were preferred when discussing previous research, only in the ACMC context were students willing to critique each other’s work.
Résumé: Un des principaux objectifs de l’enseignement du deuxième cycle universitaire est le perfectionnement de l’esprit critique, objectif qui est souvent encouragé par le concours des pairs. La présente étude compare la façon dont les étudiants diplômés inscrits à un cours de méthodologie de recherche qualitative utilisent la communication électronique asynchrone et les interactions directes en vue de critiquer les recherches propres au domaine, d’élaborer et de mener leur propre projet de recherche et de participer à des discussions professionnelles en classe et à l’extérieur de la classe. Les analyses révèlent deux choses: (1) il s’est avéré impossible d’évaluer le perfectionnement de l’esprit critique à l’intérieur d’un semestre; (2) la communication électronique asynchrone n’a pas servi de tremplin au perfectionnement avant ou pendant les échanges en classe, la communication électronique asynchrone et les interactions directes ont plutôt défendu divers objectifs sociaux et intellectuels au cours de l’utilisation de l’esprit critique. Alors que les échanges directs avaient la préférence dans la cas de recherches précédentes, ce n’est que dans un contexte de communication électronique asynchrone que les étudiants acceptaient de critiquer le travail des autres.
Collaborative learning is gaining attention in the context of teacher training in applied linguistics. Asynchronous computer-mediated communication (ACMC) promises to be an especially effective tool for collaborative learning, and a few studies have examined the efficacy of collaborative learning via this medium in graduate level education (Arnold & Ducate, forthcoming; Belz & Müller-Hartman, 2003), but none, to our knowledge, explore the development of critical thinking among pre-service teachers by using ACMC. The purpose of the present action research-based qualitative study was to explore the juncture of these three fields of enquiry by examining how weekly ACMC discussions in conjunction with classroom interactions promoted critical thinking through collaboration in a graduate seminar in applied linguistics. The results suggest that while the development of critical thinking could not be measured due to the short time-span of the study (one semester); ACMC effectively fostered critical thinking when participants reviewed each other’s work. Thus, the ACMC discussions successfully complemented the face-to-face classroom interactions.
Researchers and language educators recognize that learning is a social process rather than contained within an individual. Oxford (1997a) differentiates between cooperative and collaborative work. She describes the former as a structured set of activities that promotes the development of cognitive and social skills particular to a community, and a system of learning in which individuals and the community are held mutually accountable. It can lead to the generation of higher-order thinking skills and the development of scholarly norms among a group of peers (p. 445). Collaborative learning, in contrast, is less structured, and focuses on “acculturating the learner into a knowledge community” through engaging with other participants who are more knowledgeable (p. 444). According to Dewey (cited in Oxford, 1997b), teaching activities should create positive action and should be co-constructed by participants in a society, guided by reflection, and centered on “content-rich ideas” (Oxford, 1997a, p. 447). The present study merges these principles and defines collaboration as a process in which participants are collectively responsible for developing knowledge through structured activities, and in which the instructor’s role is to facilitate and co-participate in the learning process (Nunan, 1992b). When group members combine their knowledge, expertise and experiences, they gain exposure to diverse perspectives. Every member’s background becomes a shared wealth of knowledge, and contributes far more to each individual’s developing expertise than that person could have gained by receiving feedback from one instructor.
ACMC has strong promise to foster collaboration. It has been shown—in the context of foreign/second language (L2) learning—to (a) allow for increased participation by all interactants since they do not have to wait for others to finish talking before they can contribute their thoughts, (b) promote equality among participants and (c) remove cultural or personality barriers often found in face-to-face interactions (Abrams, 2001, 2002; Barile & Durso, 2002; Beauvois, 1998; Bruce & Kreeft Peyton, 1993; Chun, 1994; Sproull & Kiesler, 1991; Swaffar, Romano, Markley, & Arens, 1998; Warschauer, 1996, 1997). Two further positive effects of this modality have been reported: (a) openness because the lack of direct contact with one’s interlocutors reduces one’s fear of “appearing foolish” (Sproull & Kiesler, 1991, p. 42), and (b) equality across participants regardless of gender, culture or status (Baron, 1984; Kern, 1996; Sproull & Kiesler, 1991; Warschauer & Lepeintre, 1997; Zuboff, 1989).
In addition, whether interactants are willing to take the floor in face-to-face settings may depend on their ability to think quickly on their feet and plan their own utterance concurrently with listening to those of others’. Language abilities (navigating jargon effectively may be a new linguistic skill even for native speakers) may also contribute to the quality and quantity of oral exchanges. ACMC removes many of these potential hindrances to participation in interchange. Interactants may simultaneously post their comments (of any length); planning time is only limited by an interactant’s own schedule; and language resources are available for assistance (e.g., dictionaries). The more democratic power distribution in ACMC is especially important f or the development of critical thinking: there is no one central knower (e.g., the professor) who is in control of the truth, and who may not be questioned. Rather, participants are seen as more equal contributors to the (collaborative) learning process.
Baron (1984) points out two social characteristics of CMC interactions relevant to the present study. First, while “‘objective’ information [e.g., facts] can be efficiently transmitted …‘soft’ or ‘subjective’ data [e.g., personal comments] are often difficult if not impossible to convey” electronically (p. 131). Second, the time-lag involved in ACMC allows participants to plan and reformulate their comments, which is especially appealing when reviewing peer projects. Schwier and Balbar (2002) distinguish the social role of synchronous and asynchronous CMC. While they both encouraged healthy risk-taking and dynamic, challenging discussions in their study, the former helped promote a sense of community among course participants and provided “a forum for professional discussion and enriched learning” (p. 5), and the latter offered a place “well suited to ... content that required reflection ... [and] careful attention” (p. 7).
Careful reflection is essential for critical thinking, which is defined here as the purposeful use of cognitive skills for successful problem solving, evaluating information, and re-evaluating one’s assumptions about the world (Boud, Keogh, & Walker, 1985; Brookfield 1987; Halpern 1997). Critical thinking requires analytical and “argumentative capacities such as recognizing ambiguity in reasoning, identifying contradictions in arguments, and ascertaining the empirical soundness of generalized conclusions” (Brookfield, 1987, p. 11). Brookfield (1987), Halpern (1997), and King and Kitchener (1994) add planning, flexibility, self-reflection and self-correction as requirements for critical thinking.
Working with a group of equal-status peers to solve a problem is particularly conducive to the development of critical thinking skills because it exposes individuals to different perspectives and interpretations of a problem or idea. Therefore, group work tends to expand an individual’s scope of understanding, as well as their ability to “learn to reason more complexly and effectively” (King & Kitchener, 1994, p. 124). ACMC, as Table 1 illustrates, seems ideally suited to promote critical thinking through collaborative work as thus described.
Table 1. Parallels between collaboration in ACMC and critical thinking
To summarize, collaborative work that promotes critical thinking via ACMC should include evidence of (a) self- and group identity as sources of knowledge (here: researchers, experts or developing experts in the field of applied linguistics), (b) planning and referencing outside authoritative resources to support one’s own arguments (in one’s own as well as in peers’ writing), (c) ability to distinguish between reliable and less reliable sources of information, (d) revised and recursive editing of writing (content and form), and (e) synthesis of one’s own ideas with peer feedback and information from external sources (where appropriate). The present study examined student contributions in ACMC discussions, as well as in face-to-face classroom exchanges, to identify whether evidence of critical thinking was present in student work.
In order to achieve our research goal, we sought to identify effective collaborative learning practices that promote the successful development of critical thinking skills in a graduate seminar on qualitative research in applied linguistics. Since the researcher was also the course instructor, this study is best described as action research, which “calls for a practitioner to develop a theory within a system, with the goal of doing something to improve that system: theory leading to intervention, research resulting in action” (Rankin, 1999, p. 109), through systematic observation, investigation and data analysis (Nunan, 1992a; Schecter & Ramirez, 1992). In addition to describing and analyzing the way in which collaboration via ACMC may promote critical thinking, the researcher-practitioner aimed to find more effective ways of integrating ACMC into future teaching. Given the qualitative nature of the study the findings are not meant to be generalized, but they may be relevant to other educators whose philosophy of learning and teaching draws significantly on peer collaboration.
The introductory course, entitled “Qualitative Research and Applied Linguistics,” was considered the graduate students’ first exposure to qualitative research design. Its pedagogical objectives included preparing the graduate students to (a) evaluate critically the design and conclusions of previous research, (b) design and conduct their own small-scale qualitative research study, (c) analyze and interpret their own findings using existing theoretical frameworks and (d) gain confidence as qualified applied linguists (scholars and researchers). We worked towards all of these goals through pair, small group and entire class discussions, and via ACMC (see Table 2).
Table 2. Class assignments and student groupings
Given the small class size (n = 8), the entire group participated in all ACMC discussions. Most course assignments were conducted in groups of alternating sizes and constellations to ensure that students got feedback on their projects from a diverse peer audience. Where relevant, the groups were arranged to reflect the purpose of sub-tasks (e.g., a practice interview with one partner since students conducted interviews one-on-one with their research subjects). Students were regularly required to give feedback and make comments in and out of class on readings and on each others’ research based on relevant studies they read.
During the first half of the semester, students had to lead in-class, face-to-face discussions based on chapters they read from Bogdan and Biklen’s Qualitative Research for Education, and Taylor and Bogdan’s Introduction to Qualitative Research Methods, and additional articles that illustrated various aspects of qualitative research specifically in applied linguistics. In order to prepare for more in-depth, critical in-class discussions, and to promote a thoughtful exchange of ideas both on-line and in class, students had to submit questions using WebCT at least a week before their class presentation. The class session was followed by on-line discussions to further explore ideas and to provide for exchanges for which we did not have enough time in class. When the follow-up on-line discussion ended (when messages were no longer posted to the relevant discussion threads), the discussion leader was supposed to synthesize the main points of debate and discussion, connecting them explicitly to the relevant arguments, concepts and issues in the assigned readings. To set up a critical reading of studies in applied linguistics, students received a handout (see Appendix A) with questions outlining typical article formats and content with open-ended questions to guide ensuing discussions. These questions were also supposed to guide the students’ own writing of their final, research-based term papers.
During the second half of the course, class sessions were spent conducting practice interviews, discussing readings related to the students’ own projects, discussing their research designs, their proposed methods for data collection and analysis, and finally their preliminary conclusions based on their results. Each step required for the students’ own small-scale qualitative research project was modeled by the instructor and other expert guest presenters on various issues related to qualitative research (e.g., conducting sociolinguistic interviews).
The students were told at the beginning of the semester that the researcher was evaluating the efficacy of various tasks and assignments in the course. At each step (e.g., identifying research questions or themes, designing and conducting interviews, coding and analyzing data; for further details see Appendix B), the students’ critical feedback was elicited by direct questioning and by (anonymous) written surveys. For example, the students were asked to compare the intended purpose of modeled interviews with the answers the interview-subjects provided: Did the responses allow the investigator to understand the research questions better? How could the interviewer have solicited responses that were more insightful and revealing?
In addition, students were asked to situate each modeled activity in the weekly readings: How did the author of an article suggest triangulating the data? How did the researcher’s approach compare to this approach? Were there potential weaknesses in either the article or the modeled presentation? Students were also asked to critique the researcher’s analysis of all data collected, followed by a discussion of how student analyses of data compare to interpretations provided by other student groups and those provided by the researcher (data were analyzed by groups of 3-4 to promote more dynamic discussions and more rigorous analysis).
The students’ comments increased in both number and critical value as the semester progressed. This recursive, formative evaluation process was meant to ensure that student input would guide future improvements on the syllabus and pedagogical practices, and to provide triangulation for data analyses and conclusions the researcher drew. Cohen and Manion (1985), Kemmis and McTaggart (1988) and Nunan (1992b) encourage such collaboration between students, and between students and instructors, since the presence of multiple analytic voices allow for a less biased interpretative analysis. The students reported unanimously in a semester-final anonymous survey that they found both the modeling and the professional collaboration very insightful and helpful for their own projects.
Eight graduate students, from diverse scholarly backgrounds (Second Language [L2] Acquisition, Communications, African-American Literature, Elementary Bilingual Education) participated in this study. Four were American; the others were from Germany, France, Taiwan and Austria. All foreign students had spent at least one year in the U.S. prior to this study and had excellent English language proficiency; language problems were not believed to have affected the students’ willingness to talk in class. All students had had at least one course in applied linguistics.
The data consists of (a) four audio- and one video-taped class sessions over the course of five weeks (375 total minutes), (b) the students’ ACMC exchanges during weeks 6-12 (approximately 360 minutes total), and (c) student responses to an anonymously collected 13-item survey with open-ended questions regarding their self-perception as researchers and scholars, their previous experience conducting (either qualitative or quantitative) research, their comfort level with conducting research in applied linguistics and critiquing published studies as well as those of their own and their peers (collected during the last week of classes; see Appendix C).
Students working in pairs or small groups were audio-taped with individual audiotapes each time (i.e., each pair or small group had a different audiotape recording their exchanges). These audio and videotapes were transcribed verbatim for each class period; the video-recording helped organize these audiotapes for chronological sequencing, as well as provided additional confirmation of audio records during whole class discussions. All utterances recorded—including hedges, false starts, all backchannel signals—were noted during transcription (typed by the researcher using a Panasonic transcription machine, subsequently rechecked by both the researcher and several students). However, since the focus of analysis was the content of interaction rather than its linguistic manifestation, this researcher considered it unnecessary to mark overlaps, interruptions and paralinguistic features (intonation, etc.) 1 . Next, both the face-to-face and the ACMC data were analyzed by the researcher (then for validation purposes each sample was re-analyzed by the researcher and the students in the course a week later) using discourse and content analyses 2 to identify evidence of critical thinking in the questions and comments made by the students during small group, pair and whole-class interactions. For a numeric representation, idea units 3 (Crookes, 1990) comprised the basis of analyses.
Evidence of critical thinking was, for example, the presence of (a) constructively critical, probing questions, (b) suggestions for improvement of others’ research, (c) statements revealing that others’ comments were incorporated into one’s own thinking, and (d) active mention and integration of a variety of sources of information from relevant, previous literature (i.e., synthesis of arguments). Since it was impossible to ascertain the precise amount of time students spent on ACMC, for comparability the data is analyzed in percentage of idea units instead of raw minutes (i.e., 43% of total idea units talked about information or facts about the students’ own research in in-class pair discussions, and 34% of the total idea units from both ACMC and face-to-face discussions dealt with giving advice on a peer’s research projects) 4 .
The results of the survey / questionnaire were compiled verbatim from each respondent for each individual answer. For example, all responses to question 1 were listed together. This allowed an across-student comparison of answers and revealed related and divergent themes in the students’ responses. Although the surveys were meant to be anonymous, all respondents wrote their names on their questionnaires, so their initials are included in this report.
The primary purpose of this research was to examine how collaborative work via ACMC may promote critical thinking skills. At the onset of teaching this course, I had envisioned that ACMC discussions would enrich classroom face-to-face discussions by providing a forum in which student would follow up in-class discussions with continued analysis and synthesis, and would elaborate on points raised but not exhausted in the classroom, leading to a spiral discourse in which old ideas are expanded with novel observations and relevant references to theoretical, pedagogical, practical and research (design) issues. I had also anticipated, and expected as course standards, that both ACMC and face-to-face conversations would contain references to outside sources as well as to the research conducted by the subjects of this study. As the following discussion demonstrates, however, ACMC and face-to-face interactions seemed to serve distinct, but mutually supportive roles in the students’ development of critical thinking.
Given the short duration of a semester-long course it was difficult to track the development of critical thinking skills. However, in-class and ACMC discussions evinced various trends and levels of critical thinking, suggesting that using these two modalities in combination offers a rich forum for demonstrating critical thinking through collaborative learning.
To reiterate, collaborative learning in this article refers to an environment—as described by Nunan (1992b)—in which the students share the responsibility for exploring theories and practical aspects of applied-linguistics related research, and instead of waiting for the professor to convey information, students actively search for standards of practice. At this point, Hank’s (1991) and Lave and Wenger’s (1991) discussion of legitimate peripheral participation is applicable. One key aspect of Lave and Wenger’s framework requires that learners become members of a scholarly community, for example, only if they actively “gain access to sources for understanding through growing involvement” (p. 37). Furthermore, the authors posit that knowledge of and membership in such a community is reciprocal and spiral: “learning is not merely a condition for membership, but is itself an evolving form of membership” (p. 53). In the next section I examine the ways in which the participants in this study demonstrate critical thinking skills in their new scholarly community as individuals and as members of a group.
As mentioned earlier, a pre-requisite for collaborative learning is that scholars feel qualified to critique others’ work and to create their own. As the following two excerpts from the survey illustrate, the students’ feelings as scholars changed over time. The students originally assumed that they were quite qualified to conduct research and critique the existing body of literature. The students soon realized that their field-specific knowledge was limited and that they would need specialized information about qualitative research to evaluate each others’ work effectively and appropriately. Finally, the students’ feelings progressed to increased confidence as fellow researchers:
I tend to think that for some reason I was less intimidated at the beginning than later on. I was very excited and rather confident. The latter has changed a bit. J …It was kind of an illusion; it doesn’t seem possible I could be myself a researcher, and contribute to the field. (FG)
I thought it sounded romantic, something I never thought I would do because I just wasn’t a researcher. That’s something people who know something do. (CH)
These comments suggest a maturation of self-perception to an identity that is aware of the complexity of being a researcher, and which enables one to see oneself as a qualified scholar. Lave and Wenger (1991) emphasize the importance of one’s self-perception as a valid member of a given community—as well as one’s understanding of the way other members view and accept her. These comments from the survey were consistent with AT’s claims during a follow-up, in-class model interview that he had “sort of known what being a researcher was about,” but that he had not thought that he really had something to say about his topic 5.
Despite the students’ claims of feeling “inadequate” as researchers, the survey responses indicate that they ultimately perceived each others’ comments and feedback as very constructive. In response to the survey question: “What activities / assignments for this course have you found especially helpful for preparing you for your current research project?”, all eight students found that discussing their literature reviews and their research methods in small groups in class was helpful, as were the small-group and whole-class discussions pertaining to their daily readings from the main textbooks in class. They also found the practice interviews they conducted with a partner very insightful. Five of the eight students also emphasized that posting discussion questions to each other using WebCT and using ACMC for giving everyone feedback at their leisure, were very helpful. In the survey, students claimed that they felt comfortable discussing their own and their peers’ research in class, and that they felt their comments were welcome.
Analysis of the evidence from the in-class discussions and from the archived ACMC interactions, unveil a slightly different story than the survey did. These data show that students did not, in fact, share all types of comments in both face-to-face discussions and ACMC. Students analyzed primary readings articulately and critically in face-to-face discussions, but did not critique each others’ research in the same setting. Instead, they provided their peers with feedback on presentations, research design, and other suggestions solely in the ACMC setting, which—despite clear instructions that they should—they never used to critique the weekly readings. Table 3 provides an overview of the types and distribution of comments students made in the two modalities.
Table 3. Classroom and ACMC interactions: types and frequency
When working with a partner in face-to-face interactions, many of the students’ comments consisted of complaints and concerns they encountered in their research (e.g., uncooperative subjects or audio-visual equipment malfunctions). Such comments were almost always followed by a supportive response such as “That’s horrible! / I’m sure it’ll be fine.” or the other participant relating a similar difficulty about his/her own research. Questions pertaining to the students’ own research (asking for advice), questions about their partner’s research or advice they wanted to share were less than half of the pair work comment types. There were no references to other studies and sources, no critique of a peer’s work, no suggestions for improvement and very little discussion of the primary readings. Most of the pair work time was spent on (re)presenting facts and information about one’s own research, attributable perhaps to the students having to repeat the information about their own research because they had new partners each day. Little time remained to progress beyond the factual description or research to analysis. A possible solution to this problem is to assign research partners for the entire semester 6; students can get other input from the rest of the class in ACMC, for example.
During small group interaction (3-4 people), students were more likely to ask for advice regarding their own research, but most often did not get any feedback. The responses typically ignored the first commenter or offered emotional support, as illustrated by an excerpt from a small-group in-class discussion, without any actual recommendation to resolve the problem:
JB: Sometimes I feel that the professor is in his own mind, and he can’t focus on anything else but what he says. He says yes to the students, then he answers his own questions, and he gets carried away, and his answer is totally contradictory to what the students just said.
CH: So, what do I do about my coding?
KW: And I will ask the other ones for an interview on Wednesday. How many should I ask?
In this conversation JB describes a problem she encountered in her observations, but instead of suggesting solutions, CH simply begins a new train of thought about her own coding, and KW closes by not addressing either JB’s or CH’s comment, merely introducing a new topic.
In the following example from a small-group in-class discussion, MD acknowledges JB’s difficulty in collecting data, but only with a sarcastic comment, which, although not directed at JB, only recognizes JB’s frustration without providing any plausible solutions.
MD: So, have you gotten any themes from your data yet?
JB: Well, it’s been kind of hard because one class, … [the teacher] was showing a movie. She said they were having a break week.
MD: Oh, great! [sarcastic tone]
Such responses were very common in pair tasks as well; students never applied the relevant literature to their peers’ research, despite explicit instructions from the teacher to do so. These rather incoherent “exchanges” also revealed limited or non-existent critical thought. Either due to the changing nature of group constellations (and having to re-introduce one’s research repeatedly, to new audiences) there was no community history, no previous discussions to draw on, and no shared content knowledge to propel a critical examination of the speakers’ utterances. The task descriptions that were supposed to provide the cooperative structure (as defined by Oxford, 1997a) to in-class and ACMC activities seemingly went unfulfilled. Apparently, the students did not collaborate even at the most basic level.
Similarly, during entire-class interactions—even though students felt comfortable asking questions about their own research—other interactants’ responses, suggestions or advice were based only on their own experiences and personal beliefs rather than on pertinent literature on content or research design. As a matter of fact, the tendency to share difficulties and frustrations students encountered during their own data collection seemed to overshadow objective discussions; the students did not attempt to solve problems collaboratively. The multiple perspectives required by collaboration (see King & Kitchener, 1994) seemed only to provide multiple perspectives on problems, without offering solutions based on critical exploration. Repeated prompts by the instructor to refer to previous readings always resulted in several students being able to state the relevant information, however, so the ability to offer evidence from authoritative sources (a characteristic of critical thought as suggested by Brookfield , 1987; Halpern, 1997; and King & Kitchener, 1994) was not absent either.
The question of why students did not offer these connections on their own remained a mystery. Students rarely suggested relevant literature to their peers or connected the references to their own and their peers’ research topics or provided feedback on each others’ projects. It was quite poignant to see that even after in-class presentations of the students’ research designs, where students were explicitly asked for feedback by the presenter and the instructor, the audience only offered applause. Yet, concluding here that this group was simply incapable of critical thinking is inaccurate for at least two reasons.
First, discussions of the primary readings elicited quite heated intellectual debates among the participants who made insightful connections to other research and brought to light discrepancies in argumentation. Second, the presence of suggestions, syntheses, and references to other sources in ACMC underscores the notion that the problem is not a lack of critical thinking among the students, as the following excerpts from ACMC comments reveal. In these, students provide their peers with detailed, critical feedback, suggestions for improvement and information from other resources they had read (for their own research or even in other courses).
a) AT: [commenting on FG’s in-class presentation of her study and findings] FG: Good Job! ...Also, for your presentation, some feedback (for the main paper, and you’ll probably already do this J ) might be able to explain more about how you define social and linguistic. CS: Myers-Scotton (1993) admits as well that they aren’t always the same.
b) CH: The questions are very much meant as little assessments of our research, as pre- research assessments. The reason for that is that I thought that reading the chapter made me think over my research idea more carefully and take these aspects into consideration. I think it would be interesting to compare how Hammersley’s ideas of assessment might apply to our own research. [provides list of assessment criteria] Do you have to consider these aspects in your own research? How? Do you think your own study could be useful, a contribution to the field, based on these assessments?
Both AT and CH apply readings from the course to critique another’s (FG’s) or their own (CH) work. They synthesize their own opinion (that a point is still not well proven or a definition was not yet clarified) and the evidence from a peer’s presentation or their own work, and apply yet another perspective to it from course materials and other readings.
There are several possible explanations for the lack of scholarly comment regarding peers’ research in face-to-face discussions. First, the distribution of perceived permissible comments—i.e., who could be critiqued in face-to-face interactions (any personally unknown authors) and ACMC settings (peers and other authors)—may have been based on some unspoken agreement, a social rule that traversed the different genders, cultural backgrounds and research tracks among these students. Perhaps, students performed avoidance rituals (Goffman, 1967). Through these rituals, they kept a psycho-social distance from the other interlocutors, to ensure that they did not say or do anything that may have offended the other speakers when personal, emotional immediacy is a given when students share the same physical space. In the ACMC context, on the other hand, students were less careful about not performing so-called face-threatening acts (Brown & Levinson, 1987) by directly criticizing their peers. They were still cautious and mostly indirect about their feedback, and made comments coated in negative politeness, which Geis (1995) describes as “choosing not to coerce [an interlocutor] by not assuming that she is willing or able to perform some desired [or suggested] action...” (p. 98).
In addition, in face-to-face discussions, students did not have pertinent references to all of the diverse research topics their peers investigated; in order to provide useful feedback on the content of their peers’ presentations, they needed access to other resources. ACMC gave them time to reflect, and allowed them to contribute diverse perspectives and voices, to make suggestions for improvement, to synthesize what they had read, and to compose more effective comments that helped protect their peers’ and their own feelings (i.e., positive or negative face). Because in this modality they were able to separate their critique of a peer’s work from the person, plan, compose carefully, and revise their comments, they viewed ACMC as a less personal medium that helped make their comments appear more objective and professional.
Thus, the data suggest that while in-class discussions allowed for critiquing readings and research whose authors were not members of the class, peer reviews were much more effectively conducted in ACMC (as a matter of fact, that was the only forum in which such peer-critiquing took place). This seems to contradict Baron’s (1984) findings. Her study, corroborated by findings by Postmes, Spears, and Lea (1998) and Sproull and Kiesler (1991), showed that emotionally sensitive and, thus, potentially threatening comments were avoided in electronic discussions because they are easily misunderstood without intonation or other non-verbal softening markers and could easily result in face-threatening, unpleasant, unprofessional, or even aggressive exchanges. In this study, the opposite seems to be true.
Earlier, I proposed that the evidence necessary for successful collaborative work that promotes critical thinking via ACMC includes
Based on these criteria, ACMC in this study was an effective tool for promoting critical thinking through collaborative work during the second half of the semester, when students were involved in peer-critiquing tasks and collaborative learning pertaining to their own research projects. During the first half of the semester, or in instances when the participants were not critiquing each other’s work, ACMC was not only less effective, but was hardly utilized.
As stated earlier, the conclusions drawn from this study are not intended to be generalized to other contexts. More research is needed before any claims regarding the benefits of ACMC for developing critical thinking can be made. Nevertheless, several findings and reflections offer food for thought for practitioners who regularly utilize peer collaboration, especially via ACMC.
In future versions of this course, the steps involved in critical thinking will be outlined explicitly with parallels drawn between sub-assignments in preparation of the final project and the skills identified by Brookfield (1987), Halpern (1997) and King and Kitchener (1994). In addition, at least one ACMC assignment will be required that prompts peer-editing since students feel confident providing each other with feedback in this modality. The transcripts of this assignment could be used as a springboard for brainstorming in class about how students can critique their peers’ work effectively with the support of authoritative sources (e.g., primary readings on content and research). In a recent graduate seminar, I assigned different readings to each student and did not cover them in class. This practice promoted a dynamic, more in-depth discussion by all students in an ACMC setting regarding the studies’ research designs, methods and conclusions. The reception for such discussions was favourable and very often led to the students mentioning their own and their peers’ comments during in-class discussions as well.
Future research should explore how cultural, gender and language factors mentioned in relation to CMC research (see, for example, Warschauer, 1996) might affect in-class and CMC discussions at the graduate level, and how these two modalities could be harnessed for optimal learning in light of these social and personal factors. Studies should also analyze whether peer critique early on is possible even in ACMC or whether students simply need time to become comfortable with themselves as rightful collaborators in a learning community and need to have a solid foundation in content knowledge before they are willing to offer their colleagues (often friends) any type of feedback. As Matthews, Cooper, Davidson and Hawkes (1995) point out, collaborative learning requires that students become actively participating members of a shared knowledge community before they can construct knowledge through social interaction.
As we presented in the analysis, the participants in this study discussed critically the primary readings in class and used ACMC sessions to critique each others’ research. ACMC proved to be especially beneficial for graduate students because they felt they reflected on their developing identity and practices as researchers. They took advantage of ACMC’s archiving to review their own and other students’ comments and to assimilate the information they received from various sources—the primary readings, course readings, their peers’ and their own research experiences—and then provided their own well-thought-out responses to their peers.
The students in this study used the ACMC context to give and receive advice, to express and accept differing and competing opinions and to incorporate diverse sources of information to solve problems pertaining to their own research projects in collaboration with others. Although at some point scholars must learn to offer an immediate critique of a peer’s work in face-to-face encounters (e.g., at conferences), ACMC seems to offer an intermediate solution where novice researchers can provide their peers with valuable feedback and take ample time to find and offer additional resources without having to fear committing potential interpersonal transgressions.
These findings also suggest that incorporating an ACMC component into a graduate level seminar allows students to reflect on new perspectives, preferably utilizing non-teacher centered tasks and discourse, which should lead to a reflective classroom. Lave and Wenger’s (1991) claim, that “where the circulation of knowledge among peers and near-peers is possible, it spreads exceedingly rapidly and effectively” (p. 93), lends further support to the need for class activities in which learners have the freedom to explore and build on each others’ contributions to develop critical analytic skills.
I would like express my heartfelt thanks to Dr. Catherine Barrette, David Byrd, Dr. David Wright, the anonymous reviewers at CJLT, Dr. Rick Kenny and Dr. Michele Jacobsen for their very helpful feedback on various drafts of this article. Special thanks also to Dr. Janet Swaffar for her unwavering support during this writing process.
Abrams, Zs. I. (2001). Computer-mediated communication and group journals: Expanding the repertoire of participant roles. System, 29, 489-503.
Abrams, Zs. I. (2002). Surfing to cross-cultural awareness: Using internet-mediated projects to explore cultural stereotypes. Foreign Language Annals, 35(2), 141-160.
Barile, A. L., & Durso, F. T. (2002). Computer-mediated communication in collaborative writing. Computers in Human Behavior, 18(2), 173-190.
Baron, N. S. (1984). Computer mediated communication as a force in language change. Visible Language, XVIII(2), 118-141.
Beauvois, M. H. (1998). Conversations in slow motion: Computer-mediated communication in the foreign language classroom. The Canadian Modern Language Review, 54(2), 198-217.
Belz, J. A., & Müller-Hartmann, A. (2003). Teachers as intercultural learners: Negotiating German-American telecollaboration along the institutional fault line. The Modern Language Journal, 87(1), 71-89.
Boud, D., Keogh, R., & Walker, D. (1985). Reflection: Turning Experience into Learning. London, UK: Kogan Page.
Brookfield, S. D. (1987). Developing Critical Thinkers. San Francisco: Jossey-Bass Publishers.
Brown, P., & Levinson, S. (1987). Politeness. New York: Cambridge UP.
Bruce, B. C., & Kreeft Peyton, J. (1993). A situated evaluation of ENFI. In B.C. Bruce, J. Kreeft Peyton, & T. Batson (Eds.) Networked-based classrooms: Promises and realities (pp 33-49). New York: Cambridge UP.
Chun, D. M. (1994). Using computer networking to facilitate the acquisition of interactive competence. System, 22(1), 17-31.
Cohen, L., & Manion, L. (1985). Research Methods in Education. London, UK: Croom Helm.
Crookes, G. (1990). The utterance, and other basic units for second language discourse analysis. Applied Linguistics, 11(2), 183-199.
Geis, M. L. (1995). Speech Acts and Conversational Interaction. New York: Cambridge UP.
Goffman, E. (1967). Interaction ritual. New York: Anchor Books.
Halpern, D. F. (1997). Critical Thinking Across the Curriculum: a Brief Edition of Thought and Knowledge. Mahwah, NJ: Erlbaum.
Hanks, W. F. (1991). Foreword. In J. Lave, & E. Wenger (Eds.), Situated Learning: Legitimate Peripheral Participation. New York, NY: Cambridge UP.
Kemmis, S., & McTaggart, R. (Eds.). (1988). The Action Research Planner, (3rd ed.). Geelong, Australia: Deakin UP.
Kern, R. (1995). Restructuring classroom interaction with networked computers: effects on quantity and characteristics of language production. Modern Language Journal, 79, 457-476.
King, P. M., & Kitchener, K. S. (1994). Developing Reflective Judgement. San Francisco: Jossey-Bass Publishers.
Lave, J., & Wenger, E. (1991). Situated Learning: Legitimate Peripheral Participation. New York, NY: Cambridge UP.
Matthews, R. S., Cooper, J. L., Davidson, N., & Hawkes, P. (1995). Building bridges between cooperative and collaborative learning. Change, 27, 35-40.
Nunan, D. (1992a). Research Methods in Language Learning. New York: Cambridge UP.
Nunan, D. (Ed.) (1992b). Collaborative Language Learning and Teaching. New York, NY: Cambridge UP.
Oxford, R. (1997a). Cooperative learning, collaborative learning, and interaction: Three communicative strands in the language classroom. Modern Language Journal, 81, 443–56.
Oxford, R. (1997b). Constructivism: Shape shifting, substance, and teacher education applications. Peabody Journal of Education, 72(1), 35-66.
Poland, B. D. (1995). Transcription quality as an aspect of rigor in qualitative research. Qualitative Inquiry, 1(3), 290-310.
Postmes, T., Spears, R., & Lea, M. (1998). Breaching or building social boundaries? SIDE-Effects of computer-mediated communication. Communication Research, 25(6), 689-715.
Rankin, J. (1999). A Role for Action Research in the Foreign Language Classroom. Die Unterrichtspraxis, 32(2),107-119.
Schecter, S. R., & Ramirez, R. (1992). A teacher-research group in action. In D. Nunan (Ed.), Collaborative Language Learning and Teaching (pp. 192-207). New York: Cambridge UP.
Schiffrin, D. (1994). Approaches to Discourse. Cambridge, MA: Blackwell.
Schwier, R. A., & Balbar, S. (2002). The interplay of content and community in synchronous and asynchronous communication: Virtual communication in a graduate seminar. Canadian Journal of Learning and Technology, 28(2). Retrieved June 28, 2004 from http://www.cjlt.ca/content/vol28.2/schwier_balbar.html
Silverman, D. (2001). Interpreting qualitative data: Methods for analysing talk, text and interaction. (2nd ed.). London, UK: Sage.
Sproull, L., & Kiesler, S. (1991). Connections: New ways of working in the networked organization. Cambridge, MA: The MIT Press.
Swaffar, J. K., Romano, S., Markley, P., & Arens, K. (1998). Language Learning Online: Theory and practice in the ESL and L2 computer classroom. Austin, TX: Labyrinth Publications.
Warschauer, M. (1996). Comparing face-to-face and electronic communication in the second language classroom. CALICO Journal, 13, 7-26.
Warschauer, M. (1997). Computer-mediated collaborative learning: theory and practice. Modern Language Journal, 81, 470-481.
Warschauer, M., & Lepeintre, S. (1997). Freire's dream or Foucault's nightmare: Teacher-student relations on an international computer network. In R. Debski, J. Gassin, & M. Smith (Eds.), Language learning through social computing (pp. 67-89). Parkville, Australia: Applied Linguistics Association of Australia.
Zuboff, S. (1989). In the age of the smart machine. New York: Basic Books.
1. Although Poland (1995) suggests using conversation analysis and a very close reading of interviews to verify accuracy of transcriptions, such close attention to length of pauses and intonation patterns seemed uninformative in this particular study. It is important to recognize, however, that “verbatim accounts of what transpired in the interview, ... at best... are ... written records, partial accounts of a much richer interaction experience...” and that “transcription is [already in and of itself] an interpretive activity...” influenced by the abilities, care and thoroughness of the individual researcher (p. 306). Trustworthiness of the transcripts in this study was established through re-confirmation of the accuracy of transcriptions both by the researcher and by several of the students participating in the research.
2. This study utilized discourse analysis—drawing primarily on interactional sociolinguistics, pragmatics and speech act theory (for further details, see Schiffrin, 1994)—and content analysis (“establishing categories [that are clearly defined and precise to allow multiple raters to arrive at the same analysis] and then counting the number of instances when those categories are used in a particular item of texts” Silverman, 2001, p. 122) to create a typology of question and comment types students contributed, to examine their progress (if any) in critical thinking in the domain of applied linguistics.
3. Idea units were defined as phrases maintaining the same theme, and serving the same pragmatic function. As soon as the theme changed, or the pragmatic purpose of the utterance shifted (e.g. comment vs. question), a new idea unit began. Idea units (Crookes, 1990) do not require grammatical completeness as do t-units. Considering the nature of spoken language, as well as the often more informal syntax of CMC discourse, idea units were deemed more appropriate and useful for this study.
4. Approximately equal amounts of class time were dedicated to pair, small group, and entire group discussions during the five audio and video-taped class periods. In addition, students reported spending about 30 minutes on ACMC each week during the first nine weeks of the semester, then anywhere from 30 minutes to two hours per week during the last six weeks. Because of the unequal amounts of time spent on interaction in the two contexts, the idea units are presented in percentages rather than actual minutes.
5. As evidence of several students becoming fully contributing members of this new scholarly community, the following year, AT turned his research paper into an article, which was accepted for publication by a prestigious professional journal in applied linguistics, JB and FG successfully expanded their seminar papers for their masters theses, and KW used hers for her German Magisterarbeit (Masters Thesis).
6. Assigning the same partners may cause other difficulties, however, if the partners’ learning styles do not match, if one partner drops the course or if there are other kinds of mismatches between the personalities or professional goals of the two members of the dyad.
© Canadian Journal of Learning and Technology