Effectiveness of Peer Evaluation in Learning Process: A Case from Dental Technology Students
Saed S. Al-Houry2
Karem H. Alzoubi3
Omar F. Khabour4
Authors Info & Affiliations
Abstract
Background:
Peer assessment or evaluation has been shown to play an important role in several learning processes. However, the effectiveness of this educational evaluation method has yet to be studied among students in different specialties.
Objective:
The study aimed to assess the effectiveness of peer evaluation as a method of student assessments in dental technology courses.
Methods:
The study sample (n=130 students) was randomly divided into 5 groups, then the effectiveness of peer evaluation was measured and correlated with student’s Grade Point Average (GPA) and gender.
Results:
The results showed the ability of students to evaluate their peers in a certain course. As per students’ perspective, scores ranged from 3.79-4.24 (out of 5), with a high degree of practice in all fields, ranked as follows: psychological stress, teamwork, self-efficacy, and, finally, the use of social media for learning. The mean score of all the categories in the peer assessment of students was 4.005 with a high degree of practice according to Scheffe's Test. Female gender was associated with significantly higher scores in the fields of psychosocial pressure, use of social media and overall scores. In addition, students achieving a GPA of 68 and more had significantly higher overall scores compared to students with lower GPAs.
Conclusion:
Peer evaluation seems to be a valid tool for students’ assessment; thus, it can be recommended as part of the course grading system in dental technology courses and can be applied to other dental or medical courses that involve practical sessions.
1. INTRODUCTION
Specialists in public and private universities are interested in engaging students in the evaluation process, due to the effectiveness of this assessment method and the role it plays in achieving the academic and learning goals in the 21 century. Peer assessment is a system that focuses on full student integration into peer-to-peer learning under the supervision of their teacher [1]. Peer assessment has been shown to play an important role in several learning concepts such as peer learning, collaborative learning, and problem-solving skills [2]. In fact, engaging students for evaluating their learning (peer assessment) can significantly improve teaching and learning processes and students’ ability of decision-making. Advocates of the implementation of peer assessment in an educational environment believe in the effectiveness of this method in improving the learning process [3-5]. For example, Topping (1998) highlighted the importance of peer assessment in enhancing the sense of responsibility, creating motivation and acceptance of others, developing personal communication skills with intellectual activities, self-confidence, and good interaction with others [6]. In addition, Double et al., (2020) reported the importance of peer assessment as an influential approach for improving the learning environment [7]. Li et al., (2019) concluded that a positive relationship is built in the peer assessment among students, and identified the specific practices that embrace peer assessment and have a significant impact on students’ performance [8]. They identified five-component rater training, rating format, rating criteria, and frequency of peer assessment, where rater training was the most critical factor of the components [8].
Although some studies have reported certain concerns about peer assessment [9], for example, Dochy et al., (1999) indicated that peer assessment can be influenced by social factors such as friendships, collaboration, and perception of equality [10]. Similar concerns were reported in other studies [11-13]. These limitations can be overcome by randomly dividing the students in the learning environments, providing clear evaluation criteria and strong incentives for the students [14].
At the teacher level, the peer assessment method can be an effective way to monitor students’ progress at regular intervals, reducing their burden and providing students with additional feedback [15].
Omelicheva (2005) examined the self-assessment of students and peer assessment in the university context. Two experiments were conducted in the classroom curriculum to test the effects of the evaluation tool (with evaluation criteria/ without evaluation criteria), the form of evaluation (anonymous, non-anonymous), and student’s motivation (strong, weak) in peer assessment. The study findings showed both significant consistency of peer assessment in certain cases and the opposite in others. The findings showed that adding criteria to the evaluation significantly enhanced the reliability of peer assessment. A similar effect was observed when the students received incentives (being strongly motivated) to participate in peer assessment [14]. This could be an evidence of the enormous number of courses where the peer assessment is used. Students would choose to be engaged in only those courses with incentives for their participation, perhaps due to lack of time or unwillingness to participate in the study. Peer assessment has been revealed to be more accurate when rubrics are applied [16]. Peer assessment can encourage students to develop a critical attitude towards each other's professional behavior, encourage critical thinking and effective learning strategies [17, 18].
Peer assessment is utilized in various educational settings [19], including medical students [20-22], pharmacy students [23, 24], healthcare education [25-27] and in a combined group of medical and dentistry students [28]. It has also been extensively applied in medical evaluation to evaluate professional and communication skills [29, 30].
The peer evaluation method is not common in Jordan, as most of the evaluation is based on traditional methods that are centered on instructors. Previous studies report that peer assessment is rarely implemented in dental education, specifically in the operative dentistry field [11, 31, 32]. The purpose of the current study was to assess the effectiveness of peers’ evaluation as a method of evaluation of students’ academic performances in dental technology courses. There are limited studies on dentistry in Jordan. The study findings provide support to the importance of peer assessment and its impact on the evaluation of the educational process. Additionally, the results of this study might contribute to finding solutions to the challenges occurring in the evaluation of students’ learning. Moreover, the study findings can be used as a model for other medical courses that involve practical sessions in Jordan.
2. METHODS
In this prospective cohort study, the effectiveness of peer evaluation was followed up in a group of dental technology students. This study received ethical approval from the Institutional Review Board of Jordan University of Science and Technology (IRB approval number is 73/117/2018). The study protocol was in compliance with the Helsinki Declaration of 1975, as revised in 1983.
2.1. Study Instrument
A number of questions were used as an instrument for this study. The total number of questions was twenty-three. Each question belonged to one of the four main categories (fields), including self-efficacy, teamwork, psychological effect, and the use of social media to impact learning (Tables 1 and 2). A Five-level scale was used to score each question. The levels were defined as: (5) very distinct, (4) distinct, (3) good, (2) weak, (1) very weak. The questionnaire was face validated by soliciting the opinion of faculty members’ arbitrators with expertise in the field of the study. Their comments were taken into consideration where the instrument was revised based on their opinions and suggestions. The questionnaires were then pilot tested on 10 dental technology students, who were not part of the final study sample. The students were encouraged to provide comments on how they understood each question in the instrument. Again, their comments were incorporated into the final study questionnaire.
| Question Categories | Pearson correlation coefficient | Alpha Cronbach’s coefficient |
|---|---|---|
| Self-efficacy | 0.771** | 0.752 |
| Teamwork | 0.761** | 0.779 |
| Psychological pressure | 0.732** | 0.842 |
| The use of social media to impact learning | 0.731** | 0.878 |
| The Total | 0.812** | 0.878 |
| Question Categories | Mean | SD | Degree of practice | Rank |
|---|---|---|---|---|
| Self-efficacy | 3.94 | 0.54 | High | 3 |
| Teamwork | 4.05 | 0.51 | High | 2 |
| Psychological pressure | 4.24 | 0.49 | High | 1 |
| Use of social media to impact learning | 3.79 | 0.58 | High | 4 |
| The Total | 4.005 | 0.53 | High | |
2.2. Study Procedure
The sample of the study included 130 students. The inclusion criteria were a second-year undergraduate student enrolled in the dental technology course. No student enrolled in the course was excluded from the study. All students showed their willingness to participate in the study and signed the consent form of the study. The students received training sessions to evaluate their peers before conducting the study.
The students were randomly divided by the course instructor, using simple randomization, into studying groups (n=5/group) in an equal proportion to ensure the validity of the results of the study. Each group was asked to work on preparing an assignment for a specific topic and present it to all colleagues in the class. Every student was asked to assess his/her four colleagues in the same group. Few questions were related to the participation of the student in the stage of preparation of the assignment, while other questions were related to the participation of the student in the presentation of the assignment, which is mainly related to the presentation skills. The student assessment procedure was conducted by answering the twenty-three questions for each student using 1-5 scale (Table 3).
2.3. Statistical Analysis
The Cronbach-Alpha coefficient was used to measure the accuracy and stability of the questions used. The stability coefficient was 0.897, which is considered high. Data were presented as Mean ± Standard deviation (SD) or rank. T-test for two independent samples was used according to variation per gender variable and one-way ANOVA for the cumulative average. “P”. The Scheffe test was used to calculate the degree of practice and thus the values were divided into three levels; low level (1.0 -2.33), medium level (2.34-3.67) and high level (3.68-5.0). The Scheffe test was applied on each field of the questionnaire and a rank was given, according to the value of the degree of practice. Values were in the range of 1 to 6 for all fields, except psychological pressure, which was ranked between 1-5 (Table 2). The mean and standard deviation (SD) for each statement was calculated for the study sample. The mean and SD for each field were also calculated based on the answers of all statements in each field (Table 3).
| Categories/Questions | Mean | SD | Degree of Practice | Rank Within Category |
|---|---|---|---|---|
| Self-efficacy | ||||
| Has a self-confidence | 3.55 | 1.01 | Medium | 6 |
| Has the ability to explain presentation in a convincing and distinct way | 4.10 | 0.73 | High | 2 |
| Has the ability to answer questions about the assessment in a scientific manner | 4.06 | 0.79 | High | 3 |
| Has the ability to convince the group of his decisions during discussion | 3.89 | 0.98 | High | 4 |
| Select difficult tasks during roles distribution on group members | 3.96 | 0.82 | High | 5 |
| Has the ability to learn new topic in a simplified and flexible way | 4.11 | 0.92 | High | 1 |
| Teamwork | ||||
| Cooperate and assist with all members of the group during preparation of the presentation | 3.66 | 0.94 | Medium | 6 |
| Respects his collogues in the group and accepts their opinions and suggestions | 4.06 | 0.99 | High | 4 |
| Has the capability to compatibility and integration during the preparation of the assignment with the group | 3.69 | 0.94 | High | 5 |
| Commits to works deadlines in delivering what is required | 4.23 | 0.89 | High | 3 |
| Communicate continuously with the rest of the group in teams of presentation | 4.36 | 0.80 | High | 1 |
| Work with the group | 4.30 | 0.82 | High | 2 |
| Psychological Pressure | ||||
| Has the ability to accomplish and challenge difficulties when exposed to psychological stress (pressure) | 4.56 | 0.79 | High | 1 |
| Has a fear of failure, which makes him perform the tasks assigned to him better | 4.31 | 0.85 | High | 2 |
| Has the ability to monitor his emotions the accumulation of tasks | 4.26 | 0.92 | High | 3 |
| Overcomes anxiety and tension felling’s during the discussion of presentation | 4.23 | 0.87 | High | 4 |
| Has the ability not to show his emotions and social problems to group members | 3.85 | 0.89 | High | 5 |
| Use of Social Media | ||||
| Believes in the positive role of communication sites in constructive communication with group members | 4.01 | 0.94 | high | 1 |
| Learn about social network sites to enrich the assignment with the rest of the group | 3.86 | 0.75 | High | 2 |
| Devote part of his time to prepare to the assignment using social media | 3.80 | 0.81 | High | 3 |
| His cell phone is not used during discussions with group members | 3.73 | 0.80 | High | 4 |
| Urges colleagues to see social network sites to make progress of group members | 3.72 | 1.06 | High | 5 |
| Follow social network sites to keep in touch with everything new about presentation | 3.63 | 0.94 | Medium | 6 |
| Question Category | Gender | GPA | |||||
|---|---|---|---|---|---|---|---|
| Male Mean±SD | Female Mean±SD |
P-value | <68Mean±SD | 68-<84 Mean±SD |
≥84 Mean±SD |
P-value | |
| Self-efficacy | 4.01±0.49 | 3.87±0.59 | 0.13 | 4.47±0.83 | 4.67±0.58 | 4.59±0.59 | 0.11 |
| Working in team spirit | 4.16±0.43 | 3.93±0.56 | 0.16 | 4.72±0.64 | 4.93±0.20 | 4.95±0.12 | 0.17 |
| Psychological pressure | 3.78±0.47 | 4.29±0.51 | 0.02* | 4.68±0.65 | 4.85±0.27 | 4.90±0.20 | 0.25 |
| Use of social media to impact learning | 3.97±0.57 | 3.65±0.59 | 0.02* | 4.70±0.55 | 4.89±0.24 | 4.93±0.15 | 0.41 |
| The tool as a whole | 3.70±0.40 | 4.10±0.44 | 0.03* | 4.64±0.21 | 4.83±0.25# | 4.83±0.23# | 0.02 |
3. RESULTS
The sample of the study consisted of 130 students, 68 males and 62 females. According to the Grade Point Average (GPA/100%), 37 students had a GPA of less than 68, whereas 47 students had a GPA of more than 68 to less than 84. Still, 41 students had a GPA of 84 and more. Table 2 shows an assessment of students’ ability to evaluate their peers. As per students’ perspective, their evaluation ability ranged from 3.79-4.24 in all fields of the questionnaire, which is considered a high degree of practice according to Scheffe test. According to the degree of practice, fields were ranked as follows: psychological stress, teamwork, self-efficacy, and the use of social media to impact learning. The overall mean of the four fields of the questionnaire was 4.005, with a high degree of practice.
Table 3 shows the scores for the ability of students to evaluate their peers in each of the after-mentioned fields. Within the self-efficacy field, scores ranged from 3.55 to 4.11 with a high degree of practice in all statements except self-confidence. For teamwork, scores ranged from 3.66-4.36 with a high degree of practice for all statements except “Cooperate and assist with all members of the group during preparation of the presentation”. For psychological stress, scores ranged from 3.85 to 4.56 with a high degree of practice for all statements. Finally, for the use of social media, scores ranged from 3.63 to 4.01 with a high degree of practice for all statements except “Follow social network sites to keep in touch with everything new about presentation”.
For the fields of psychosocial pressure, use of social media and overall scores, female gender was significantly associated with higher scores (Table 4). For GPA, the overall scores were significantly higher among students with GPA scores of 68 and more compared to students with lower GPAs.
4. DISCUSSION
In the current study, a case of success of using peer assessment in a dental technology practical course was presented. The study findings showed a high overall mean of all categories of questions (4.005 out of 5) as per the students’ perspectives. The study findings promote the use of peer assessment as an evaluation-tool for learning in the field of dental technology. This includes the implementing social control in the learning environment, the preparation of students for self-monitoring and self-regulation in lifelong learning, and the active participation of students in the classroom. The most well-known goal of peer assessment is its use as an evaluation tool. Recently, it has been increasingly encouraged for its role in promoting learning in educational practice [33].
Peer assessment has been reported as a tool to recognize active participation of students in their learning, and to create student-centered learning environments [34]. In fact, peer assessment represents a core part of theories of formative assessment since it has been viewed as providing new information about the learning process to the teacher/student, which sequentially empowers later performance [35]. Peer assessment is useful as a student engagement tool [26] and encourages lifelong learning [29].
The result of this study agrees with previous studies that reported the benefits of peer assessment to students [36, 37]. The benefits are classified as follows: high-quality learning, thus, encouraging the transfer of learning, thinking, enhancing students’ learning experiences, providing students with a better understanding of evaluation standards, and eliminating ambiguity associated with assessment. Skills development via improving negotiation, student’s ability to work in a collaborative way, and stimulating lifelong learning. Personal development, including increasing students’ responsibility and the independence of the student. Emotional development via increasing student’s confidence, and autonomy [36, 37].
In a meta-analysis study that involved several peer assessment studies, peer assessment was found to resemble teacher assessment more closely when standard judgments based on well-understood criteria were used [38]. In the current study, it was noted that students’ scores during peer-evaluation tended to be high. This is in agreement with a previous study that was conducted on pharmacy students [39]. The instructor made a lot of efforts to encourage students to do their best assessment. As for the quality of the assessed material, students were given a training session explaining how to do a proper peer evaluation. It was reported that conducting workshops to train students in assessing their peers improved the quality of feedback for the students [40]. However, bias from this side is still possible, which is one of the inherited limitations of the peer assessment method [41, 42].
In the present study, for the fields of psychosocial pressure, use of social media and overall scores, the results showed that the female gender was significantly associated with higher scores. In a previous study that examined the effect of gender on group work process and performance using the peer-assessment in the British higher education system, it was shown that male gender was associated with underperformance [43]. Similarly, a study that was conducted in two universities in Australia and included over 1500 students in four different degree programs, showed that females received significantly higher ratings than males [44]. Gender has also been found to have a role in peer assessment outcomes in other investigations [45, 46]. For GPA, the current study showed that a GPA of 68 and more was associated with significantly higher overall peer assessment scores compared to students with lower GPAs. Thus, both GPA and gender should be considered when using peer assessment approaches.
CONCLUSION
The present findings provide a case of successful peer assessment in dental technology practical courses. Thus, the recommendations are to promote the use of peer assessment method. Educational institutions should be encouraged to conduct teacher-training workshops, develop different evaluation processes for students, and focus on peer assessment. It is also necessary to make students know the importance of peer assessment and its role in the cooperative learning process and developing skills among students.
ETHICS APPROVAL AND CONSENT TO PARTICIPATE
This study received ethical approval from the Institutional Review Board of Jordan University of Science and Technology, Jordan (IRB approval number is 73/117/2018).
HUMAN AND ANIMAL RIGHTS
No animals were used in this research. All human research procedures followed were in accordance with the ethical standards of the committee responsible for human experi- mentation (institutional and national), and with the Helsinki Declaration of 1975, as revised in 1983.
CONSENT FOR PUBLICATION
All patients participated on a voluntary basis and gave their informed consent.
AVAILABILITY OF DATA AND MATERIALS
The data supporting the findings of the article is available upon request from the corresponding author [N.M].
FUNDING
This study was supported by the Deanship of Research at Jordan University of Science and Technology, Jordan (Grant number: 440/2018).
CONFLICT OF INTEREST
The authors declare no conflict of interest, financial or otherwise.
ACKNOWLEDGEMENTS
Declared none.
