Strategic Management Thought

Developing Situational Judgment Test (SJT) for predicting college students performance

Document Type : Research Paper

Authors

1 Imam Sadiq University

2 Faculty of Islamic Studies and Management, Imam Sadeq University, Tehran

Abstract

Due to the important role in identifying and nurturing competent people for society, universities have this concern as well and try to find students who can help them in implementing their policies as well as society policies. The questions is how should people factors be assessed to be able to find and develop competent people. So with introducing situational judgment test and a model for developing SJT, this research tries to develop a SJT for predicting students performance. SJT is an assessment tool in which different situations are abstracted from real situations and participant need to determine which options are suitable in that situation. To do this research, first student competencies of one of management faculties of Tehran universities has classified from past research and 7 clusters were developed, then important situations for students has been gathered from past research and faculty members were asked to rate them according to the "importance index". The final questionnaire contained 35 questions and presented to a 93 student sample. After analysing the results, reliability of 0.67 and validity of 0.271 for predicting average students scores and 0.298 for predicting students points were obtained which are acceptable according to past research in the field. Students performance can be predicted with acceptable validity and low cost and time with the SJT designed. Procedural justice, student development, self awareness and transferring expectations of university to students are other benefits of this tool.

Keywords

Main Subjects

‫ایرجی راد، ارسلان و ارداغیان، زهره (1395). تحلیل عاملی مؤلفه‌های شایستگی‌های کانونی در برنامه­ی آموزشی. فصلنامه اندازه­گیری تربیتی. ۷ (26). ۷۷-۱۰۰.
جاهد، حسینعلی و خسروی، الناز (۱۳۹۷). شایستگی‌های آموزشی و پژوهشی موردنیاز دانشجویان برای موفقیت در زندگی دانشگاهی. دوماهنامه علمی ـ پژوهشی راهبــردهای آموزش در علوم پزشکی. 11 (1). ۴۹-۵۸.
‫سیف، علی‌اکبر (1396). اندازه گیری، سنجش و ارزشیابی آموزشی (ویرایش هفتم). تهران: نشر دوران.
‫شارع­پور، محمود؛ صالحی، صادق و فاضلی، محمد (۱۳۸۰). بررسی میزان شایستگی‌های کانونی در میان دانشجویان (مطالعه موردی: ‌دانشگاه‌های صنعتی شریف، تهران و مازندران). نامه علوم اجتماعی. ۱۸ (2). ۸۸-۶۳.
‫عقیلی، سارا؛ نفری، ندا؛ قیومی، عباسعلی و قربانی‌قلجلو؛ رحیم (1399). طراحی الگوی توسعه فردی به­عنوان رویکردی استراتژیک در توسعه منابع انسانی سازمان‌های دانش‌بنیان (مورد: شرکت‌های فناوری اطلاعات و ارتباطات منتخب). نشریه پژوهش در نظام‌های آموزشی. 14 (ویژه‌نامه). 53-68
‫‫گنجی، مهدی واتفاقی، مهناز (1390). آمار در روانشناسی و علوم رفتاری. تهران: نشر ساوالان
‫مدهوشی، مهرداد و نیازی، عیسی (۱۳۸۹)، «بررسی و تبیین جایگاه آموزش عالی ایران در جهان». آموزش عالی ایران. 2 (۴). ۱۴۷-۱۱۱.
منصوری‌لطفعلی، عقیل؛ ایمانی، محمدتقی و شریفی، اصغر (1399). شناسایی عوامل مؤثر بر معنویت سازمانی در دانشگاه‌های علمی کاربردی استان تهران. نشریه پژوهش در نظام‌های آموزشی. 14 (ویژه‌نامه). 495-507.
Atkinson, R. C. (2001, April). Standardized tests and access to American universities. Lecture delivered at the 83rd annual meeting of the American Council on Education, Washington, DC.
Bergman, M. E., Drasgow, F., Donovan, M. A., Henning, J. B., & Juraska, S. E. (2006). Scoring situational judgment tests: Once you get the data, your troubles begin. International Journal of Selection and Assessment. 14 (3). 223-235.
Berman, Jeffrey، Ritchie, Leah، 2006. Competencies of Undergraduate Business Students. Journal of Education for Business. 81 (4). 205-209.
Boyatzis, R.E (1982) "The competent Manager: A model for effective performance" by John Wley and sons, New York
Cardy Robert، L، Selvarajan، T.T.، 2006.Competencies: Alternative frameworks for competitive advantage. Business Horizon. 49 (3). 235-245.
Catano, V.M., Brochu, A. and Lamerson, C.D. (2012), Reliability of Situational Judgment Tests. Int J Select Assess. 20 (3). 333-346.
Draganidis, F., & Mentzas, G. (2006). Competency based management: A review of systems and approaches. Information management & computer security. 14 (2). 51-61.
Dubois, D. D., & Rothwell, W. J. (2004). Competency-based human resource management. Palo Alto, Calif: Davies-Black.
Fogg, C. D. (1999). Implementing your strategic plan: How to turn "intent" into effective action for sustainable change. American Management Association
Hezlett, S. A., Kuncel, N. R., Vey, M. A., Ahart, A. M., Ones, D. S., Campbell, J. P., et al. (2001, April). The predictive validity ofthe SAT: Ameta-analysis. Paper presented at the 16th annual conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
Huffcutt, A. I., & Arthur, W. (1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology. 79 (2). 184–190.
Lepsinger, Lucia. (1999). The Art and Science of Competency Models. San Francisco: Jossey-Bass
McDaniel, M. A. & Nguyen, N. T. (2001). Situational judgment tests: A review of practice and constructs assessed. International Journal of Selection and Assessment. 9 (1-2). 103-113.
Lievens, F., Peeters, H. and Schollaert, E. (2008), "Situational judgment tests: a review of recent research", Personnel Review, 37(4), 426-441.
Motowidlo, S. J., Dunnette, M. D., & Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology. 75 (6). 640-647.
O'Connor, M. C., & Paunonen, S. V. (2007). Big Five personality predictors of post-secondary academic performance. Personality and Individual Differences. 43 (5). 971–990.
Oswald, Frederick L.; Schmitt, Neal; Kim, Brian H.; Ramsay, Lauren J.; Gillespie, Michael A. (2004): Developing a biodata measure and situational judgment inventory as predictors of college student performance. In The Journal of applied psychology. 89 (2). 187–207.
Patterson, Fiona; Lievens, Filip; Kerrin, Máire; Munro, Neil; Irish, Bill (2013): The predictive validity of selection for entry into postgraduate training in general practice: evidence from three longitudinal studies. In The British journal of general practice. the journal of the Royal College of General Practitioners. 63 (616). e734-41.
Peeters, Helga; Lievens, Filip (2005): Situational Judgment Tests and their Predictiveness of College Students’ Success. The Influence of Faking. In Educational and Psychological Measurement. 65 (1). 70–89.
Ployhart, R. E., & Ehrhart, M. G. (2003). Be careful what you ask for: Effects of response instructions on the construct validity and reliability of situational judgment tests. International Journal of Selection and Assessment. 11 (1). 1-16.
Robertson, I.T. and Smith, M. (2001), Personnel selection. Journal of Occupational and Organizational Psychology. 74 (4). 441-472.
Rotundo, M., & Sackett, P. R. (2002). The relative importance of task citizenship, and counterproductive performance to global ratings of job performance: A policy-capturing approach. Journal ofApplied Psychology. 87 (1). 66–80.
Salgado, Jesus. (1998). Big Five Personality Dimensions and Job Performance in Army and Civil Occupations: A European Perspective. Human Performance. 11 (2-3). 271-288
Salvatori P. (2001). Reliability and validity of admissions tools used to select students for the health professions. Adv Health Sci Educ Theory Pract. 6 (2). 159-75.
Schmitt, Neal (2014): The Oxford Handbook of Personnel Assessment and Selection. 1st. issued in paperback. Oxford: Oxford University Press (Oxford library of psychology).
Sternberg, R. J., Wagner, R. K., Williams, W. M., & Horvath, J. A. (1995). Testing common sense. American Psychologist. 50 (11). 912-927.
Stevens, Jared, "The Development of a Situational Judgment Test to Assess Collegiate Judgment: A Pilot Study" (2018)
Whetzel, D. L., & McDaniel, M. A. (2009). Situational judgment tests: An overview of current research. Human Resource Management Review. 19 (3). 188-202.
Strategic Management Thought
Volume 17, Issue 1 - Serial Number 35
March 2023
Pages 143-166
  • Receive Date: 17 May 2023
  • Revise Date: 01 August 2023
  • Accept Date: 13 August 2023