Research Article

Comparison of Lecture Based and Modified Team Based Learning in Achieving Cognitive Skills in Medical Education

Quratul Ain Tahira1*, Sidrah Lodhi1 and Sajid Abaidullah2

1Assistant Professor of Medicine, KEMU/ Mayo Hospital, Lahore; 2Professor of Medicine, KEMU/ Mayo Hospital, Lahore, Pakistan.

Received | June 10, 2017; Accepted | January 10, 2018; Published | April 07, 2018

*Correspondence | Dr. Quratul Ain Tahira, Assistant Professor of Medicine, KEMU/ Mayo Hospital, Lahore; Email: [email protected]

Citation | Tahira, Q.A., S. Lodhi and S. Abaidullah. 2018. Comparison of lecture based and modified team based learning in achieving cognitive skills in medical education. Annals of King Edward Medical University, 24(1): 93-99.

DOI | https://doi.org/10.21649/akemu.v24i1.2338

Keywords | Lecture based learning, Team based learning, Cognitive domains

Introduction

Didactic lecture, the classical mode of dissemination of knowledge, was developed in ancient times by Great Greek Orators (1) and remains in practice today.(2) A large number of students could be taught simultaneously by a single teacher who is considered to be the source of knowledge. It is highly valued for economic and logistic advantages but is considered a passive or teacher-centered mode of learning.(1) Due to limited interaction between teacher and learners, teaching becomes monotonous and boring and learners quickly lose interest. More importantly, the learning outcomes remain limited to memorization and at the most comprehension of knowledge unless the students are highly motivated.(3)

It is worth mentioning that higher order thinking skills (HOTS) are essential for progression in any professional field.(4) These skills enable the professionals to design and conduct research, write books, develop new concepts and critically appraise existing work.

Dr. Benjamin Bloom, an American educational psychologist, made great contributions to the development of mastery learning and exceptional talent for achievement of eminence and greatness. In1956, the taxonomy of learning objectives was put forth under his leadership famously known as Blooms taxonomy(5) His aims were to enhance higher forms of thinking in education such as analysis and evaluation of concepts. This taxonomy has remained a fundamental element in the educational community since then.(4)

Bloom divided learning into three domains of cognition, affective and psychomotor skills. The cognitive domain was further divided into six categories (C1-C6) of knowledge, comprehension, application, analysis, synthesis, and evaluation.(4,5)

Since then efforts have been made to devise teaching methods to incorporate these superior qualities of cognition in students. In the medical field, the introduction of problem-based learning (PBL) in the late 1960s in McMaster University, Toronto, Canada is a notable example.(6) It is an active educational approach conducted in small groups in which learners are asked to solve open-ended problems by seeking key information. In this student centered approach, the teacher acts as facilitator. (6) This powerful mode of teaching remained limited in practice due to logistic reasons. Extensive faculty development and more physical space for small groups working independently were required. (7)

Dr. Larry Michaelson made another such effort. In 2005, he introduced team based learning (TBL) in business schools. It was an active learning strategy, relatively free of logistic problems. (8) It was later adopted in medical education as well. (1)

In this method, teaching is conducted in five steps. Basic learning material is provided to the students to prepare for the TBL session. At the start of the TBL session, the learners take an initial MCQ test, the individual readiness assurance test (IRAT). This is done to motivate and create sense of accountability in each team member. The learners are then split into teams consisting of 5 or 7 members each. The same MCQ test is now answered after mutual discussion and developing consensus between the team members. This is called team readiness assurance test (TRAT). Finally, the teams are supposed to answer questions pertaining to practical application of newly acquired knowledge. The facilitator gives feedback immediately so that the students can rethink and realize their mistakes. The teacher then delivers a mini lecture to clarify misconceptions noted in the TRAT and to prepare the learners for the final most important step of practical application of newly acquired knowledge. The learners are then asked to answer relevant questions. All the teams are supposed to answer simultaneously and to explain and defend their choices to other teams. Thus, the learners are made to analyze and evaluate situations and are motivated to plan and synthesize, the capabilities vital for the progress of the profession.(8,9) TBL method allows flexibility and can be modified at every step depending upon the demands of the curriculum and approach.(10,11,12)

While TBL has gained popularity over the last decade, several disadvantages have been reported as well. Social loafing is one of them. This means that one or more members do not participate effectively in the teamwork. This leaves increased work load on the remaining members.(13) Moreover, the situation at the workplace might be different from the class room(14) Lack of adequate instructor preparation is also an important challenge.(15) In a systematic review, it was observed that medical students didn’t prefer TBL to other teaching methodologies. In view of the authors, this might be due to increased workload and accountability.(8)

In Pakistan, the traditional didactic lecture is still the most popular and widely used mode of information transfer in medical education.(12) In theory classes. PBL and TBL have been introduced at very few places.(12) In King Edward Medical University, didactic lecture is the primary mode of information transfer for undergraduate medical education. PBL has been adopted for few courses but TBL has not been introduced as yet.(16) Furthermore, Fatmi et al in their systematic review of the effectiveness of TBL in health professions education found that studies focusing on critical thinking abilities and application of knowledge were limited and recommended the need for further research in this area.(8) They further commented that at present there is only preliminary evidence for utility of TBL on improving learning outcomes.(8)

In view of the existing scenario, this study was planned to compare the effectiveness of mTBL versus conventional lecture in achieving various cognitive skills.

 

Methodology

This comparative cross sectional study was conducted in the Department of Medicine, King Edward Medical University, Lahore, Pakistan in April 2017 after approval from the institutional review board.

The study participants were 53 resident doctors (RDs) including house officers (HOs) and postgraduate residents (PGRs) who had been working on the medical floor for at least 2 months. Resident doctors who had previously done internship, house job or formal training in preventive medicine, preventive pediatrics or community medicine departments were excluded from the study. Non-probability purposive sampling was used to recruit the study participants. Written informed consent was taken after explaining the purpose of study and confidentiality was ensured. The participant RDs were randomly allocated to group 1 and group 2 using stratified random sampling technique with stratification being done based on designation i.e., HOs and PGRs.

Group 1 comprised of 29 RDs including 17 HOs and 12 PGRs while group 2 comprised of 24 RDs including 14 HOs and 10 PGRs. Group 1 was allocated for lecture based learning (LBL) while group 2 was assigned modified team based learning (mTBL). TBL was modified in three ways. Firstly, the participants were not given any reading material for pre-class preparation. Secondly, the TRAT was not conducted. Lastly, the FT was taken by individual participants rather than teams.

The theme selected for lecture and discussion in this study was “Disease Prevention & Health Promotion.” This topic is included in the under graduate MBBS curriculum(17) and is formally taught in fourth year MBBS class in Community Medicine lectures and practical activities. During clinical years, the students, HOs & PGRs have the opportunity to apply this knowledge by counseling/advising the patients regarding adoption of healthy lifestyle and disease prevention measures. Due to the importance, applicability, generality and broad scope of the subject, the authors were not only able to obtain sufficient material for the lecture and discussion but also had room for setting questions to test various cognitive domains. The lecture was prepared with mutual agreement between authors who also finalized the reading material for mTBL session. One of the authors was prepared and guided to deliver the lecture. Another author was trained by the research team to conduct the mTBL session including facilitation of discussion stage, identification of common problems and delivery of mini lecture as required by the participants. Both the LBL and mTBL sessions were conducted simultaneously in separate lecture halls.

Both group 1 and 2 undertook an initial test, the IRAT to assess the baseline knowledge of the participants. Group 1 attended the LBL session, which comprised of a 45 minutes’ lecture utilizing audiovisual aids. 10 minutes were reserved at the end of the lecture for question & answer session to clarify any problems identified by the RDs.

Group 2 was further subdivided into 4 teams each comprising of 6 members including 2-3 PGRs and 3-4 HOs. Printed material was handed over to the teams for study. Discussion among the team members was encouraged to identify difficult areas. 45 minutes were allocated for this activity. The facilitator helped to sort out the problems that arose during the discussion. The facilitator compiled the problem areas identified by the team and delivered a 10 minutes’ mini lecture addressing these areas.

Both groups were then administered a final test (FT) which was specially designed to assess all six levels of cognitive domain. The six cognitive domains were grouped as early including C1-3 and advanced including C4-6 levels. The ability of FT to test various cognitive domains was done by taking opinion from senior faculty members well versed in medical teaching.

All the data were transferred to a specially designed proforma and entered in SPSS-20.0 for analysis. Mean± SD was calculated for continuous variables (age, IRAT score and FT score) and frequency distribution and percentages for categorical variables (gender and designation). Statistical comparison was done for IRAT and FT scores and performance in early and advanced domains. Independent sample t-test for continuous variables and Chi-square test for categorical variables were used in the statistical analysis. P-value < 0.05 was considered significant in all the analyses done.

 

Results

A total of 53 RDs including 31 (58.49%) HOs and 22 (41.51%) PGRs working on the medical floor of our hospital participated in the study. The RDs were divided into 2 groups; LBL (group 1) and mTBL (group 2). LBL group comprised of 17 (58.62%) HOs and 12 (41.38%) PGRs, while the mTBL group comprised of 14 (58.33%) HOs and 10 (41.67%) PGRs. The mean ages and gender distribution of the two groups were comparable as shown in Table 1.

The mean IRAT scores for the two groups before the activity are also shown in Table 1. Both the groups had comparable IRAT scores (p-value 0.272).

 

Table 1: Baseline characteristics of LBL and mTBL groups

Characteristics	LBL	mTBL	p-value
Designation: HOs (%) PGRs(%)	58.49 41.38	58.33 41.67	0.983 0.983
Age – years (Mean±SD)	26.21±2.71	25.67±2.46	0.456
Gender – Males (%)	51.7	70.8	0.157
IRAT Score (Mean±SD)	41.03±17.79	44.17±19.54	0.272

 

The overall FT scores were 40.26 ±15.17 and 48.02 ±17.57 respectively for LBL and mTBL groups with p-value of 0.045, which was statistically significant. The FT scores were then analyzed for early and advanced cognitive domains. The FT scores in early domains were 34.81±14.93 and 56.12 ±15.1 for LBL and mTBL groups (p-value 0.000), which showed a significant improvement in mTBL group. The scores of advanced domains were 35.53±12.65 and 30.56±14.73 for LBL and mTBL groups, which did not show a statistically significant difference (p-value0.301) (Table 2).

Comparison of IRAT and FT scores on the basis of designation showed that performance of PGRs was significantly better than HOs in early domains, but not in advanced domains as shown in Table 3. Gender-based comparison revealed no statistical difference in performance of male and female RDs as shown in Table 4.

 

Table 2: FT scores of LBL &mTBL groups

Scores	LBL	mTBL	p-value
Overall	40.26±15.17	48.02±17.57	0.045
Early Domains	34.81±14.93	56.12±15.1	0.000
Advanced Domains	35.53±12.65	30.56±14.73	0.301

 

Table 3: Designation-based comparison

Scores	House officers	PGRs	p-value
IRAT	41.93±18.15	43.18±19.37	0.406
Overall FT	41.45±17.34	47.05±15.29	0.115
Early Domains	40.83±19.99	49.57±14.60	0.043
Advanced Domains	30.43±13.19	33.33±14.14	0.223

 

Table 4: Gender-based comparison

Scores	Male	Female	p-value
IRAT	45.31±17.96	38.1±18.87	0.083
Overall FT	44.06±18.80	43.33±12.97	0.438
Early Domains	45.41±16.21	43.01±21.49	0.322
Advanced Domains	31.25±15.58	32.22±9.96	0.400

 

Discussion

In the present study, two modes of teaching were compared for learning outcomes in terms of cognitive skills in two groups of RDs. One group attended a conventional lecture while the second group was assigned a session of modified TBL. TBL is learner-oriented while LBL is teacher-oriented mode of learning. Furthermore, the performance of teams is better than individual members 97% of the time as described by Michaelson, the pioneer of TBL.(18) Therefore, modification of TBL, for the purpose of this study, enabled us to compare two entirely different modes of teaching. TBL modification is not a new concept; several authors have previously compared LBL and TBL in different ways.(10, 11, 12)

The number of sessions of TBL has been variable in previous studies. Hashmi compared the test score of a single lecture with that of a single session of modified TBL conducted three weeks later.(12) Hameed et al have compared two TBL sessions with eight conventional lectures.(19) Bleske et al have compared TBL and LBL in a six weeks cross over model.(20) Jafari compared eight sessions of lecture with eight sessions of TBL in a neurology course.(21) We conducted a single session of mTBL in the present study. This was due to the fact that entire teaching schedule of undergraduate MBBS classes is planned at the outset of each academic year. It is not feasible to intercept it and conduct sessions of TBL until the medical education department implements it. Therefore, we conducted this study on our RDs who are at various stages of clinical training. Their future plans regarding choice of specialty, rotations to departments other than internal medicine and monthly duty schedules are variable. Therefore, we conducted a single session on a topic of common interest and importance. We intended to establish its usefulness before recommending it as another instructional methodology.

In our study, the overall performance of RDs was significantly better in the mTBL group (p value 0.045). In addition, they performed significantly better in early cognitive domains in the mTBL group (p value 0.00) whereas the performance was almost the same (p value 0.301) in the advanced cognitive domains. This observation is quite interesting and noteworthy. Bleske et al tested the cognitive domains of recall (C1) and application (C3) of knowledge. In both of these domains, TBL group performed significantly better.(20) This result is similar to our study where we observed a significant improvement in early cognitive domains (C1-3) in the mTBL group. Jafari used MCQs as assessment tool for lecture session while TBL sessions were assessed by IRAT and GRAT (group readiness assurance test) scores and reported superior outcomes in the TBL sessions.(21) She also noted that GRAT scores were significantly higher than IRAT.(21) This supports the philosophy that wisdom of crowd is superior to wisdom of individuals. Use of different assessment tools for the two methods of teaching might also have introduced a bias.

TBL was mainly designed to achieve higher order learning skills.(9,18) In our study, there was no advantage of mTBL over LBL in achieving these cognitive domains. There may be several reasons for this observation. We modified TBL session to enable the comparison of two different teaching methodologies. The FT was administered to individuals and not to the teams. The philosophy of TBL states that higher order thinking is facilitated by team input. Secondly, our study results are based on a single LBL and mTBL session. Extension of TBL sessions may show the desired results. Lastly, we feel that our RDs have not been trained in higher order thinking skills (HOTS). They are taught by conventional lectures during most of their undergraduate studies in theory classes. Collins has suggested that HOTS are a skill to be developed like other skills and the teaching strategies must be targeted to develop HOTS.(4)

In this study, both groups of RDs comprising of HOs and PGRs were comparable at the outset as shown by the IRAT scores of LBL and mTBL groups (p-value 0.406). The FT scores of the two groups showed some interesting observations. The PGRs performed better than HOs in early domains of FT (p-value 0.043) but not in advanced domains (p-value 0.223). The result of early domains was expected, as the PGRs are at a higher level of knowledge and training than the HOs. The scores of advanced domains probably reflect that PGRs are not well trained in HOTS.

The overall performance of male and female RDs was comparable in the IRAT (p-value 0.083) and in both the early and advanced domains (p-value 0.332 and 0.400 respectively) in FT. This reflects that there is no discrimination based on gender in our institution. Other researchers have shown different results in this regard. In the LBL & TBL comparative study by Jafari, gender did not affect the scores in conventional lectures but the girls performed better in TBL sessions.(21) Wiener however showed contradictory results.(22) In that study although women were more satisfied with TBL, but in both initial and final examination, men achieved higher score in TBL.(22) It remains to be seen whether these differences reflect the different learning needs of the two genders.

 

Conclusion

This study demonstrated that when compared to LBL, a session of modified TBL brought about a significant improvement in early cognitive domains. We propose that few sessions of TBL may be included in the undergraduate curriculum and further studies to be carried out to establish its efficacy and utility in the local context.

 

Author’s Contribution

Quratul Ain Tahira: Concieved the study design, prepared learning material and lectures, collected and interpreted the data and drafted the manuscript.

Sidrah Lodhi: Helped the first author in designing the study, collection and interpretation of the data and drafting of the manuscript.

Sajid Abaidullah: Helped the first author in designing the study, collection of the data, reviewed the manuscript

 

References

1. Compton S, Kamei R, Cook S. The history and future of team-based learning. Proceedings of Singapore Healthcare. 2016 Jan; 25(1):3-4. https://doi.org/10.1177/2010105815624427
2. Majhi P, Sulakhe R. Didactic lectures and small group discussions among undergraduate students in a medical college – A comparative study. J Educ Res Med Teach. 2014; 2(2):10-11.
3. Roopa S, Geetha M B, Rani A, Chacko T. What type of lectures do students want? - A reaction evaluation of dental students. J ClinDiagn Res. 2013 Oct; 7(10):2244-6. https://doi.org/10.7860/JCDR/2013/5985.3482
4. Collins R. Skills for the 21st Century: teaching higher-order thinking. Curriculum & Leadership Journal. 2014 Aug 29; 12.
5. Bloom BS. Taxonomy of educational objectives: The classification of education goals: Cognitive Domain. NY: Longman; 1956.
6. Schmidt HG, Rotgans JI, Yew EH. The process of problem‐based learning: what works and why. Medical education. 2011 Aug 1; 45(8):792-806. https://doi.org/10.1111/j.1365-2923.2011.04035.x
7. Neville AJ. Problem-based learning and medical education forty years on. Med Princi Prac. 2009; 18(1):1-9. https://doi.org/10.1159/000163038
8. Fatmi M, Hartling L, Hillier T, Campbell S, Oswald AE. The effectiveness of team-based learning on learning outcomes in health professions education: BEME Guide No.30. Med Teach. 2013 Dec; 35(12):1608-24. https://doi.org/10.3109/0142159X.2013.849802
9. Michaelsen LK, Sweet M. The essential elements of team‐based learning. New directions for teaching and learning. 2008 Dec 1; 2008(116):7-27. https://doi.org/10.1002/tl.330
10. Dharmasaroja P. Modified team based learning Is it an improvement? [Internet]. Med Ed World; 2017 Aug 29[cited 2018 Jan 3]. Available from: https://www.mededworld.org/Reflections-All/Reflection-Items/August-2017/Modified-team-based-learning-is-it-an-improvement.aspx
11. Vasan NS, DeFouw DO, Holland BK. Modified use of team based learning for effective delivery of medical gross anatomy and embryology. Anat Sci Educ. 2008 Jan; 1(1):3-9. https://doi.org/10.1002/ase.5
12. Hashmi NR. Team Based Learning (TBL) in undergraduate medical education. J Coll Physicians Surg Pak. 2014 Aug; 24(8):553-6.
13. Hansen RS. Benefits and problems with student teams: suggestions for improving team projects. J edu bus. 2006; 82(1):11-9.
14. Ashraf M. A critical look at the use of group projects as a pedagogical tool. J edu bus. 2004; 79(4):213-6. https://doi.org/10.3200/JOEB.79.4.213-216
15. Peterson CH. Building the emotional intelligence and effective functioning of student workgroups: evaluation of an instructional programme. College teaching. 2012; 60(3):112-21. https://doi.org/10.1080/87567555.2011.645258
16. Qureshi AU, Sadiq MA, Mumina A. Report of the subcommittee constituted for comparison of modular system of curriculum of King Edward Medical University, Lahore, DOW University, Karachi, Aga Khan University, Karachi and John Hopkin’s medical school USA. Lahore: King Edward Medical University. p.10.
17. Pakistan medical & dental council & higher education commission Islamabad. Curriculum of MBBS, Revised 2011.Islamabad; PMDC; 2011. p.88
18. Michaelsen LK, Watson WE, Black RH. A Realistic Test of Individual Versus Group Consensus Decision Making. J App Psychol. 1989; 74(5):834–9. https://doi.org/10.1037/0021-9010.74.5.834
19. Hameed S, Khalid T, Aslam S, Ahmad M, Farhan F, Batool Z et al. Team based learning in pathology: effect on test scores and student satisfaction. Pak Armed Forces Med J. 2017; 67(3):423-28.
20. Bleske BE, Remington TL, Wells TD, Klein KC, Guthrie SK, Tingen JM, Marshall VD, Dorsch MP. A Randomized Crossover Comparison of Team-based Learning and Lecture Format on Learning Outcomes. Am J Pharm Educ. 2016 Sep 25; 80(7):120.
21. Jafari Z. A comparison of conventional lecture and team-based learning methods in terms of student learning and teaching satisfaction. Med J Islam Repub Iran. 2014; 28:5.
22. Wiener H, Plass RM. Team-based Learning in Intensive Course Format for First-year Medical Students. Croat Med J. 2009; 50(1):69–76. https://doi.org/10.3325/cmj.2009.50.69