ISSN: 2754-6659 | Open Access

Journal of Artificial Intelligence & Cloud Computing

Analysis of Faculty Teaching Performance Based On Student Feedback Using Fuzzy Mamdani Inference System

Author(s): <p>Vedna Sharma* and Sourabh Jain</p>

Abstract

The objective of this study was to develop an Inference System based on the Fuzzy Mamdani system for assessing the teaching skills of faculty members in academic or educational institutions. Nowadays, many academic institutions have adopted web-based methods to gather students' feedback on faculty members' teaching effectiveness. Evaluating faculty performance in teaching activities is crucial for establishing a more equitable academic environment. The primary goal of assessing faculty performance is to identify areas of strength and weakness in their professional development. This application of soft computing, specifically the Fuzzy Mamdani Inference System (FMIS), in evaluating faculty teaching performance can be valuable for organizational management in assessing faculty capabilities and their impact on student outcomes.

Introduction

In academic institutions, the performance of teaching faculty is evaluated to enhance teaching quality and identify individual strengths and weaknesses. A teacher's quality encompasses various skills, personal attributes, and knowledge relevant to their specific subject area and effective assessment practices [1].

The evaluation of faculty performance within an educational organization involves coordination, planning, and assessment through multiple channels, including student feedback, peer assessment, and overall institutional examination results. When evaluating faculty teaching ability, it is important to differentiate between teacher quality and teaching quality, considering the benefits of research and student achievements [1].

To assess faculty teaching performance in an institution, it is crucial to plan and integrate review areas such as gathering student feedback and management assessment based on institutional or university results. The assessment criteria for faculty performance may differ across academic institutions, but the data collected is typically quantitative in nature. This data often lacks precision and certainty, making it suitable for analysis using soft computing techniques.

Conventional approaches to assessing faculty performance, primarily relying on student feedback, are not scalable for developing automated techniques. These traditional evaluation methods can be time-consuming and prone to calculation errors. In contrast, fuzzy-based systems are effective in handling uncertain datasets. Researchers have explored different techniques, such as Neuro Fuzzy Systems, to address this issue [2].

In this study, we employ a Fuzzy Mamdani Inference System (FMIS) for faculty evaluation based on student feedback. The FMIS is chosen due to its suitability for human inputs, easily comprehensible rule bases, and widespread acceptance. It assists in making decisions for performance appraisal and enables educational institutes and universities to exercise professional judgment in evaluating their faculty. In the Mamdani Inference System, the output of each rule is represented as a fuzzy set.

Literature Study

Odokuma et al. [3] have developed a system utilizing the Fuzzy Mamdani Inference System for assessing Academic System Requirements in Educational Organizations. The main objective of this study is to employ the Fuzzy Mamdani Inference System (FMIS) for evaluating Academic Standing and Continuation Requirements in Educational Institutes. The system aims to identify students who are at risk of failing out at an early stage. The research demonstrates that the model can effectively identify and provide guidance to students whose performance is below expectations, thus helping them avoid failure and dropout.

Ghosh et al. [4] have proposed a method for analyzing faculty teaching skills based on student feedback. This study introduces a ranking method that utilizes various fuzzy operators to compute the solutions of Fuzzy Relation Equations. The method deals with uncertainty in evaluating factors related to teacher performance. The authors propose a Fuzzy Expert System that employs fuzzy logic to evaluate faculty overall performance, particularly under conditions of "uncertain facts or data" in decision-making processes. The research aims to assist in writing annual performance reports, such as Annual Confidential Reports (ACR), for employees in organizations.

Yadav et al. [6] have utilized a fuzzy logic approach to evaluate the performance of teachers in academic institutes. This study presents a comprehensive method that encompasses various applications in educational systems, including not only the evaluation of students' academic performance but also the assessment of faculty members.

Khan, Abdur Rashid et al. [7] has proposed an Expert System with Fuzzy Logic for evaluating Teacher's Performance. This study demonstrates the use of fuzzy logic techniques to handle qualitative and undefined data in the decision-making process. The application of fuzzy logic in evaluating teachers' performance is an attempt to address these challenges. The authors developed a Proficient System that acquired domain-specific knowledge and obtained interesting results, providing a framework for researchers to explore solutions to various complexities in this field.

Proposed Fuzzy Model for Faculty Performance Evaluation

The faculty evaluation process involves systematically assessing Faculty Performance based on their professional contributions and role in achieving organizational objectives within a specific context. Intelligent fuzzy evaluation methods can aid in creating management rules and making optimized decisions by incorporating expert knowledge.

This research aims to develop an expert system utilizing fuzzy logic techniques for evaluating teachers' performance. A fuzzybased model is introduced to assess faculty performance by considering their involvement in various sub-activities within the organization or institution.

Fuzzy Expert System

The fuzzy Expert System involves several steps, namely Fuzzification, Fuzzy Reasoning, and Defuzzification

Fuzzification

During the process of fuzzification, the input variables are categorized into distinct linguistic variables like "Excellent," "Very Good," "Good," "Fair," and "Poor." Subsequently, membership functions are created by assigning suitable ranges to each of these variables. These membership functions can take various forms, such as triangular, Gaussian, trapezoidal, or singleton, depending on the specific requirements.

Fuzzy Reasoning

In this stage, the fuzzy rules are utilized within an inference mechanism to compute the degree of membership of the input to the fuzzy-based output.

Defuzzification

Conversion of fuzzy values into crisp values.

img

The Dataset

The subsequent sections provide a description of the input and output variables employed in this work, along with their respective linguistic terms.

Inputs:

1. Organization of classes: Faculty's role in organizing and preparing for classes
2. Punctuality: Timeliness in conducting classes
3. Utilization of teaching aids: Implementation of various teaching aids by faculty during classroom instruction
4. Effective communication: Proficient communication and clarification during presentations
5. Supportive learning environment: Creation of a comfortable and conducive learning atmosphere
6. Student engagement: Interaction with students within the classroom setting
7. Classroom discipline: Ensuring discipline and orderliness in the class

img

img

A feedback form, referred to as Table 1, was created to assess the teaching skills of faculty members. The form underwent validation through peer review and incorporated inputs from students via anonymous submission. Only students with a minimum attendance of 60% were eligible to complete the feedback form.

img

Implementation and Result

The proposed model was implemented in MATLAB (R2017a) using the Fuzzy Logic Design Toolbox. For this model there are 5 inputs developed, one output Fuzzy Mamdani model as shown in figure 2. The recommended Fuzzy Expert System was tested with feedback of 100 students’ about faculty’s teaching skills which is obtained from an academic institute. The graphical representation of the input and output variables are shown in figures 3-4.

img

img

Fuzzy Rule and Inference Mechanism

The fuzzy logic controller operates similarly to the human reasoning process through an inference mechanism. It is a subset of Artificial Intelligence (AI) and employs fuzzy logic-based techniques. In evaluating teachers' teaching performance, specific fuzzy rules are defined. These rules establish the input and output membership functions utilized in the inference process. The soft computing model depicted in Figure 1 incorporates a fuzzy logic controller. In this controller, appropriate rules are triggered, and the degree of membership of the output fuzzy variable, which represents faculty teaching performance, is determined by encoding the relevant fuzzy subsets.

img

img

Results

To evaluate the model and the defined rules, a dataset was gathered from a well-regarded academic institute for the current study. The collected input data, along with the output variable representing the overall performance of the teacher, were used to determine the faculty's teaching performance using both a conventional method and the developed fuzzy model. The two end columns of Table 4 display the values of faculty teaching performance obtained through the direct method and the Fuzzy Expert System (FES), respectively.

img

img

img

img

Conclusion & Future Research

This paper employs Soft Fuzzy Logic Techniques, specifically the Fuzzy Mamdani System, for evaluating faculty teaching performance. Table 4 provides a comparison between the classical method and the fuzzy Mamdani Inference system method for teaching performance evaluation. In the classification method, the feedback inputs are evaluated using the standard mean deviation method.

img

img

img

Future Research

This paper introduces a Fuzzy Mamdani Inference method for evaluating faculty performance using fuzzy logic techniques. In future research, it would be beneficial to collect additional inputs such as CGPA, overall faculty performance, and examination results to analyze the overall academic performance of academic institutes. Additionally, exploring the combination of artificial neural networks with fuzzy systems, known as Neuro-Fuzzy Systems, holds promise for further advancements in this field and is worth investigating

References

  1. Alam Javed, Pandey,Dr Manoj (2017) A Soft Computing Model for Evaluating Teachers’Overall Performance using Fuzzy Logic. Journal of Information Technology & Software Engineering 7: 2-9.
  2. Zarni Sann, Thi Thi Soe, Thae Su Lwin (2018) Teacher performance evaluation using Neuro-Fuzzy techniques. International Journal of Advanced Scientific Research 3: 54-62.
  3. Ekenta, Obagbuwa Ibidun (2017) Development of a Fuzzy Mamdani Inference System for the Assessment of the Academic Standing/Continuation Requirements in Higher Educational Institutions. International Journal of Computer Trends and Technology 46: 10-14.
  4. Ghosh Dhrubajyoti, Pal Anita (2015) Analysis of Faculty Teaching based on Student feedback using Fuzzy Relation Equation. International Journal of Applications of Fuzzy Sets and Artificial Intelligence 5: 91-109.
  5. Chaudhari O (2012) Soft Computing Model for Academic Performance of Teachers Using Fuzzy Logic. British Journal of Applied Science & Technology 2: 213-226.
  6. Yadav Ramjeet Singh, Vijendra Pratap Singh (2011) Modeling academic performance evaluation using soft computing techniques: A fuzzy logic approach. IJCSE 3: 676-686.
  7. Khan Abdur Rashid, ur rehman Zia, Amin Hafeez Ullah (2011) Application of Expert System with Fuzzy Logic in Teachers Performance Evaluation. International Journal of Advanced Computer Science and Applications - IJACSA 2: 51-57.
  8. S Mardikyan, B Badur (2011) Analyzing Teaching Performance of Instructors Using Data Mining Techniques. Journal of Informatics in Education 10: 245-257.
  9. Bai Samita, Sharaf Hussain, Quratulain Rajput, Shakeel A Khoja (2014) Faculty performance evaluation system: An ontological approach. 2014 IEEE/ACS 11th International Conference on Computer Systems and Applications (AICCSA) 117-124.
  10. Hani I Mesak, Lawrence R Jauch (1991) Faculty Performance Evaluation: Modeling to Improve Personnel Decisions 22: 1142-1157.
  11. Khan AR, Amin HU, Rehman ZU (2011) Application of Expert Systemwith Fuzzy Logic in Teachers Performance Evaluation. International Journal of Advanced Computer Science and Applications 2: 51-57.
  12. Kamath RS (2014) Design and development of soi computing model for teaching st? performance evaluation. International Journal of Engineering Sciences & Research Technology 3: 3088-3094.
  13. Alam J, Pandey MK (2015) Design and analysis of a two stage traffic light system using fuzzy logic. Journal of Information Technological and 6oiware Engineering 5.
  14. Kamath Rajani, Bhosale, Geetanjali (2012) Fuzzy Inference Sytem for Teaching Staff Performance Appraisal. International Journal of Computer and Information Technology 2: 381-385.
  15. Neogi Amartya, Mondal, Abhoy, Mandal Soumitra (2011) A Cascaded Fuzzy Inference System for University NonTeaching Staff Performance Appraisal. Journal of Information Processing Systems 7: 595-612.
  16. Z Yildiz, A F Baba (2014) Evaluation of student performance in laboratory applications using fuzzy decision support system model. IEEE Global Engineering Education Conference (EDUCON), Istanbul 1023-1027.
View PDF