CIPP Model Evaluation on TOEFL Course at Higher Education
Abstract
To assist future graduates, students of the English Language Education Study Program receive specialized training in a 'TOEFL' course that is specifically designed to prepare them for the TOEFL test. The objective of this research is to assess the effectiveness of the TOEFL course offered in this study program as a mandatory advanced course, which can be taken in either the sixth or eighth semester. This study presents a CIPP (Context, Input, Process, Product) evaluation methodology specifically designed to meet the requirements and unique features of the TOEFL course at Universitas Qomaruddin. This research is needed to investigate (1) What are the outcomes of evaluating TOEFL courses using the CIPP approach? (2) What are the key enhancements that need to be implemented in order to maximize the program's beneficial influence, as perceived by students and lecturers, in terms of program outcomes? By employing this quantitative and qualitative methodologies, our aim is to provide a comprehensive assessment framework capable of addressing several research inquiries. The research involved a total of 42 students, a lecturer, and a head of the study program. The research data utilized encompass surveys, interviews, and documentation. The quantitative data were analyzed using descriptive statistics, while qualitative data from interviews and documentation were examined thematically to complement and explain the numerical findings. ubsequently, the data is scrutinized and inferences are made. The results show TOEFL course was generally executed well proven by effectiveness from context evaluation (82%), input evaluation (83%), process evaluation (86%), and product evaluation (82%). These findings indicate that the TOEFL course meets its objectives effectively. However, continuous improvements in infrastructure, resources, and engagement strategies are recommended to enhance the program's overall quality and long-term impact. This study provides practical insights for curriculum designers and educators seeking to evaluate and optimize similar programs.
Downloads
References
Akbari, O., & Sahibzada, J. (2020). Students’ Self-Confidence and Its Impacts on Their Learning Process. American International Journal of Social Science Research, 5(1). https://doi.org/10.46281/aijssr.v5i1.462
Angraini, N. (2016). Types of English Language Test. Global Expert: Jurnal Bahasa Dan Sastra, 5(1). https://doi.org/10.36982/jge.v5i1.139
Aprilliandari, D. I., & Sugiharto, P. A. (2023). TOEFL Preparation Training Program To Enhance Students’ TOEFL Score. Jurnal Education and Development, 11(1). https://doi.org/10.37081/ed.v11i1.4327
Baghaei, S., Bagheri, M. S., & Yamini, M. (2020). Analysis of IELTS and TOEFL reading and listening tests in terms of Revised Bloom’s Taxonomy. Cogent Education, 7(1). https://doi.org/10.1080/2331186X.2020.1720939
Braun, V., & Clarke, V. (2019). Reading list and resources for Thematic Analysis. In Thematic Analysis: A Reflexive Approach, University of Auckland (Issue 2019).
Brown. H. D. (2007). Teaching by Principles, Second. In Teaching by Principles An Interactive Approach to Language Pedagogy.
Capuno, J. G. C. (2023). Quizziz: A Game-based Formative Assessment Tool for Enhancing Students Self-Regulated Learning. International Journal of Social Learning (IJSL), 3(3). https://doi.org/10.47134/ijsl.v3i3.206
Coorey, J. (2021). Cooperative learning in design education. International Journal of Design Education, 16 (1). https://doi.org/10.18848/2325-128X/CGP/V16I01/117-126
Cowan, J. (2011). Research methods in education - By Louis Cohen et al. British Journal of Educational Technology, 42(5). https://doi.org/10.1111/j.1467-8535.2011.01222.x
Creswell., J. W. (2017). Qualitative inquiry and research design : choosing among five approaches - 3rd edition. In Экономика Региона.
Dalimunte, A. A., Tika, A., Dalimunte, M., Tanjung, A. P., & Suryani, I. (2023). Evaluating TOEFL ITP Test: A Critical Review. Humanitatis : Journal of Language and Literature, 9(2). https://doi.org/10.30812/humanitatis.v9i2.2329
Damayanti, E., Ibrahim, M. M., & Ismail, Muh. I. (2022). Evaluation of Online Learning Programs at Universities Using the CIPP Model. Jurnal Educative: Journal of Educational Studies, 6(1). https://doi.org/10.30983/educative.v6i1.4678
Frazier, S., & Brown, H. D. (2001). Teaching by Principles: An Interactive Approach to Language Pedagogy. TESOL Quarterly, 35(2). https://doi.org/10.2307/3587655
Hai, N. C. (2022). Factors Affecting Student Satisfaction with Higher Education Service Quality in Vietnam. European Journal of Educational Research, 11(1). https://doi.org/10.12973/EU-JER.11.1.339
Hajarudin, H. (2022). Model Pembelajaran Bahasa Inggris Mahasiswa Stie Ganesha. Khatulistiwa Jurnal Pendidikan Dan Sosial Humaniora, 2(3).
Hartono, H., Sakinah, R. M. N., & Nirwana, R. (2021). Tingkat Kemampuan Bahasa Inggris Dosen Tetap Perguruan Tinggi Swasta Di Jawa Barat Berdasarkan Skor Toefl; Studi Kasus Di Universitas Al-Ghifari Bandung. Al-Tsaqafa : Jurnal Ilmiah Peradaban Islam, 18(2). https://doi.org/10.15575/al-tsaqafa.v18i2.14974
Herwandar, R., Safryono, D. A., & Haryono, P. Y. (2012). Evaluasi Program Matrikulasi ”TOEFL” Mahasiswa Universitas Al Azhar Indonesia 2010/2011. Jurnal Al-Azhar Indonesia Seri Humaniora, 1(3). https://doi.org/10.36722/sh.v1i3.67
Husain, R., Arifin, A., Cakranegara, P., Victornie, I., Perdana, I., & Nugroho, B. S. (2022). Analysis of student satisfaction with the quality of education services. Cypriot Journal of Educational Sciences, 17(2). https://doi.org/10.18844/CJES.V17I2.6802
Ismail, F. A., Bungsu, J., & Shahrill, M. (2022). Improving Students’ Participation and Performance in Building Quantities through Think-Pair-Share Cooperative Learning. Indonesian Journal of Educational Research and Technology, 3(3). https://doi.org/10.17509/ijert.v3i3.50348
Juliarta, I. M., & Wirawan, I. G. N. (2022). Pelatihan Bahasa Inggris Toefl Bagi Mahasiswa Jurusan Keperawatan. Jurnal Warta Desa (JWD), 4(2). https://doi.org/10.29303/jwd.v4i2.183
Junining, E., & Prawoto, S. (2020). Evaluasi Model Program Kelas Internasional di Perguruan Tinggi dalam Perspektif Kelembagaan. Hasta Wiyata, 3(2).
Kaniadewi, N., & Asyifa, D. I. (2022). The Effect of TOEFL Preparation Course on EFL Undergraduate Students’ TOEFL Scores. Linguistic, English Education and Art (LEEA) Journal, 6(1). https://doi.org/10.31539/leea.v6i1.4365
Kusmiyati, N., Hamidah, & Kadir. (2023). CIPPO Model Evaluation on the English Language Training Program At the Indonesian Navy Education Services. IJHCM (International Journal of Human Capital Management), 7(1). https://doi.org/10.21009/ijhcm.07.01.8
Labibatussolihah, L., & Adriani, N. M. (2022). An evaluation of the effectiveness of the English Upgrading program for TOEFL in an Indonesian university using the CIPP model. Jurnal Penelitian Dan Evaluasi Pendidikan, 26(2). https://doi.org/10.21831/pep.v26i2.48728
Maharani, M. S., & Putro, N. H. P. S. (2021). Evaluation of TOEFL preparation course program to improve students’ test score. Jurnal Penelitian Dan Evaluasi Pendidikan, 25(1). https://doi.org/10.21831/pep.v25i1.39375
Mahmudi, I. (2011). CIPP: Suatu Model Evaluasi Program Pendidikan. At-Ta’dib, 6(1). https://doi.org/10.21111/at-tadib.v6i1.551
Manan, A., Fadhilah, M. A., Kamarullah, & Habiburrahim. (2020). Evaluating paper-based toefl preparation program using the context, input, process, and product (Cipp) model. Studies in English Language and Education, 7(2). https://doi.org/10.24815/siele.v7i2.16467
Manurung, B. C., & Suseno, M. (2022). Program Evalutaion of English Club Using Cipp Model in Primary School. … : A Journal of …, 5(2).
Masruroh, L., & Miladiyah, N. (2023). English Teacher’s Strategy in Teaching Writing. Lingual: Journal of Language and Culture, 16(2). https://doi.org/10.24843/ljlc.2023.v16.i02.p05
Mazidah, E. N., & Masruroh, L. (2022). Interactional Metadiscourse in Students’ Abstracts across Studies at Universitas Qomaruddin. Linguists : Journal Of Linguistics and Language Teaching, 8(2). https://doi.org/10.29300/ling.v8i2.6443
Narayana, I. G. P. P., & Soepriyanti, H. (2023). Students’ Difficulties in Coping with TOEFL Test: A Case Study in a Postgraduate English Program of a State University in Mataram. International Journal of Multicultural and Multireligious Understanding, 10(6). https://doi.org/10.18415/ijmmu.v10i6.4780
Park, S., Kwak, E. J., Tak, J. young, & Tate, T. (2020). Investigation on TOEIC score trends in Korea and its pedagogical implications. Cogent Education, 7(1). https://doi.org/10.1080/2331186X.2020.1796557
Prisuna, B. F. (2022). Online Learning Evaluation of Mathematics Using the CIPP Model. JINOTEP (Jurnal Inovasi Dan Teknologi Pembelajaran): Kajian Dan Riset Dalam Teknologi Pembelajaran, 9(2). https://doi.org/10.17977/um031v9i22022p167
Pujiastuti, E., Muliyah, P., Aminatun, D., Hakim, L. N., & Septiyana, L. (2021). The Evaluation of English Teaching Learning Process Using CIPP Model. Conference on English Language Teaching, 1. https://doi.org/10.24090/celti.v1.1
Rahman, R., Kondoy, E., & Hasrin, A. (2020). Penggunaan Aplikasi Quizziz Sebagai Media Pemberian Kuis Dalam Meningkatkan Motivasi Belajar Mahasiswa. JISIP (Jurnal Ilmu Sosial Dan Pendidikan), 4(3). https://doi.org/10.36312/jisip.v4i3.1161
Rifiyanti, H., Dewi, D. U., & Putra, F. M. (2023). The Role of TOEFL Preparation Courses in Improving Test Score. Foremost Journal, 4(2). https://doi.org/10.33592/foremost.v4i2.3615
Rifiyanti, H., Dewi, D. U., Putra, F. M., & Kurniawan, A. (2023). Pelatihan Toefl Preparation Dan Strategi Menghadapi Real-Test. Beujroh : Jurnal Pemberdayaan Dan Pengabdian Pada Masyarakat, 1(1). https://doi.org/10.61579/beujroh.v1i1.14
Rohman, K. A. (2019). The Students’ Perceptions On A Test Of English Proficiency As Graduation Requirement. LLT Journal: A Journal on Language and Language Teaching, 22(2). https://doi.org/10.24071/llt.v22i2.2031
Rojak, O. Bin. (2022). Pelatihan TOEFL ITP untuk Mahasiswa Tingkat Akhir Politeknik Ketenagakerjaan. Acitya Bhakti, 2(1). https://doi.org/10.32493/acb.v2i1.14410
Sanjaya, I. A. R., Suprianti, G. A. P., & Paramartha, A. A. G. Y. (2023). The Implementation of Quizziz as Assessment for Learning in English as A Foreign Language: The Teacher’s Perspective. The Art of Teaching English as a Foreign Language, 4(2). https://doi.org/10.36663/tatefl.v4i2.628
Shih, Y. C. D., & Yuan, Y. P. (2019). Evaluating an English Elite Program in Taiwan using the CIPP model. Journal of Asia TEFL, 16(1). https://doi.org/10.18823/asiatefl.2019.16.1.13.200
Shofi, A. T. (2020). ELTICS (English Language Teaching and English Linguistics) Employing Multimedia-Based Learning To Improve English Speaking Skills. JOURNAL, 5(1).
Shofi, A. T., Mazidah, E. N., & Ni’mah, F. (2018). Penerapan Multimedia dalam Pembelajaran Bahasa Inggris pada Guru Sekolah Tingkat Dasar dan Menengah. JPP IPTEK (Jurnal Pengabdian Dan Penerapan IPTEK), 2(1). https://doi.org/10.31284/j.jpp-iptek.2018.v2i1.246
Situmorang, K., Nugroho, D. Y., Sihombing, M. R., & Manurung, E. I. (2020). Pengenalan TOEFL ITP dan Sharing Belajar ke Luar Negeri. Jurnal Pengabdian Pada Masyarakat Membangun Negeri, 4(2).
Stufflebeam, D. L. (1971). The relevance of the CIPP evaluation model for educational accountability. The Relevance of the CIPP Evaluation Model for Educational Accountability.
Stufflebeam, D. L. (2002). Cipp Evaluation Model Checklist. Evaluation, June.
Sulaiman, M., Marliasari, S., Hartati, S., Rofifah, N. R., & Anggita, D. (2019). Pelatihan Toefl Remaja Karang Taruna Tunas Mulia. Suluh Abdi, 1(2). https://doi.org/10.32502/sa.v1i2.2300
Tannenbaum, R. J., & Wylie, E. C. (2005). Mapping English Language Proficiency Test Scores Onto The Common European Framework. ETS Research Report Series, 2005(2). https://doi.org/10.1002/j.2333-8504.2005.tb01995.x
Warju, W. (2016). Educational Program Evaluation using CIPP Model. Innovation of Vocational Technology Education, 12(1). https://doi.org/10.17509/invotec.v12i1.4502
Zhang, Q. (2022). Impacts of World Englishes on local standardized language proficiency testing in the Expanding Circle: A study on the College English Test (CET) in China. English Today, 38(4).
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) before and during the submission process, as it can lead to productive exchanges and earlier and greater citation of published work.
_(1).png)
