Analytic Hierarchy Process and Multi-Factor Evaluation Process Methods for Proposal Research Evaluation

Teotino Gomes Soares; Marcelo  Fernandes Xavier Cham; Tenia  Wahyuningrum; Abdullah  Z. Abidin

Teotino Gomes Soares Department of Computer Science, Dili Institute of Technology, Dili, Timor-Leste
Marcelo Fernandes Xavier Cham Department of Computer Science, Dili Institute of Technology, Dili, Timor-Leste
Tenia Wahyuningrum Faculty of Informatics at Institut Teknologi Telkom Purwokerto, Indonesia
Abdullah Z. Abidin Founder of Professional IT Consultant Enterprise, Professional IT Consultant Enterprise, Kedah, Malaysia

Keywords: Analytical hierarchy process, Multi-factor Evaluation Process, Proposal research evaluation

Abstract

Evaluation of scientific research proposals is one of the most important factors in determining the quality of research results to be obtained so that they can contribute to the development of science and technology in harmony with people's lives, so this needs to be considered. However, the process of evaluating scientific research proposals is not an easy matter because it involves a variety of complex causal factors and sub-factors in conducting evaluations in a consistent and objective manner. Therefore, we propose the AHP and MFEP methods with causal factors, namely originality, novelty, contribution, methodology, reputation journal references, research roadmap, research member, up-to-date references, percentage of references, tools references, references styles, proposal format, and thirty-three (33) other sub-factors. This study aims to provide knowledge about how the AHP and MFEP methods can be combined to evaluate scientific research Proposals. The AHP method is used to calculate the weight of the priority level values for each causal factor and sub-factor that will be used by the MFEP method, while the MFEP method is used to calculate the evaluation weight value for each alternative by utilizing the value of the priority level of causal factors and sub-determining factors resulting from AHP, as well as calculating the total value of the evaluation weight for each alternative. The results showed that both methods can be used to evaluate scientific research proposals by obtaining five (5) alternative candidates for research grant winners from CARPS-CS with a total evaluation weight value of = 50% out of ten (10) alternative candidates.

Downloads

Download data is not yet available.

References

Adriyendi and Melia, Y. (2021) ‘Multi-Attribute Decision Making using Hybrid Approach based on Benefit Cost Model for Sustainable Fashion’, International Journal of Advances in Data and Information Systems, 2(1), pp.9–24.

Afolabi, I.T. et al. (2019) ‘Decision Support System for Final Year Project Management’, Proceedings of the World Congress on Engineering and Computer Science 2019, 0958.

CARPS_CS (2023) ‘Matadalan Proposta Peskiza’. Dili: CARPS_CS DIT.

Fernando, E. and Siagian, P. (2021) ‘Proposal to Use the Analytic Hierarchy Process Method Evaluate Bank Credit Submissions’, Procedia Computer Science, 179, pp. 232–241. Available at: https://doi.org/10.1016/j.procs.2021.01.002.

Handayani, M. and Kifti, W.M. (2020) ‘Implementation of Multi Factor Evaluation Process (MFEP) Method in Decision Support System for Selection of Best LABORANT’, Proceeding International Conference on Social, Sciences and Information Technology, pp.323–328.

Jayady, A. et al. (2021) ‘Decision Support System with Multi Criteria Decision Making Technique’, Virtual Conference on Engineering, Science and Technology (ViCEST) 2020, 1–9. Available at: https://doi.org/10.1088/1742-6596/1933/1/012017.

Kellaghan, T. (2010) ‘Evaluation Research’, Elsevier Ltd., pp.150–155.

Leite, R.A.S. et al. (2019) ‘Portfolio Evaluation of Academic Patent : A Proposal to Brazil’, J. Technol. Manag. Innov. 2019., 14(4), pp.66–77.

Limbong, T. et al. (2020) ‘Implementation Of Multi Factor Evaluation Process (MFEP) In Assessment Of Employee Performance Achievement’, Journal of Physics: Conference Series, pp. 1–9. Available at: https://doi.org/10.1088/1742-6596/1573/1/012022.

Meidelfi, D. et al. (2021) ‘The Implementation of SAW and BORDA Method to Determine the Eligibility of Students ’ Final Project Topic’, International Journal on Informatics Visualization, 5(2), pp.144–149.

Pujiastuti, L. et al. (2021) ‘Method Implementation Multifactor Evaluation Process (MFEP) in Recommending the Best Types of Cattle for Beef Cattle Farming’, Jurnal Mantik, 5(1), pp.147–152.

Que, B.J. et al. (2021) ‘Decision Support System using Multi-Factor Evaluation Process Algorithm Decision’, Virtual Conference on Engineering, Science and Technology (ViCEST) 2020, pp.2–8. Available at: https://doi.org/10.1088/1742-6596/1933/1/012016.

Saaty, T.L. (2008) ‘Decision Making with the Analytic Hierarchy Process’, Int. J. Services Sciences, 1(1), pp.83–98.

Saaty, T.L. and Vargas, L.G. (2012) Models, Methods, Concepts & Applications of the Analytic Hierarchy Process. Second Edi. USA: Springer. Available at: https://doi.org/10.1007/978-1-4614-3597-6.

Sahoo, B., Pattnaik, P.K. and Behera, R.N. (2022) ‘MCDM Based Usability Evaluation of E-Governance Services using Human Perception’, Journal of Theoretical and Applied Information Technology, 100(21), pp.6561–6571.

Sasty, T.L. (1990) ‘How to Make an Decition: The Analytic Hierarchy Process’, European Journal of Operational Research, 48(9–26).

Setiawan, H., Dhamayanti and Tasmi (2022) ‘Local Government Project Assessment Application Using Group Decision Support System ( GDSS ) Model’, Journal of Information Systems and Informatics, 4(4), pp.1053–1062.

Soares, T.G. et al. (2023) ‘Determinate Student Final Project Supervisor Based AHP and SAW’, American Journal of Artificial Intelligence, 7(2), pp.31–39. Available at:https://doi.org/10.11648/j.ajai.20230702.11.

Spaapen, J., Dijstelbloem, H. and Wamelink, F. (2007) Evaluating Research in Context. Second edi. Netherlands: Consultative Committee of Sector Councils for Research and Development.

Sundari, S. et al. (2019) ‘Decision Support System on Selection of Lecturer Research Grant Proposals using Preferences Selection Index’, The International Conference on Computer Science and Applied Mathematic, pp. 1–8. Available at: https://doi.org/10.1088/1742-6596/1255/1/012006.

Susanti (2021) ‘Implementation of the Multi Factor Evaluation Process (MFEP) Method in Making Decisions on Providing Assistance to Underprivileged Students’, International Journal of Informatics and Computer Science, 5(3), pp.336−343.

Tarifu, L. et al. (2021) ‘Decision Support System Simulation Application with MFEP Method’, Journal of Physics: Conference Series, pp. 2–9. Available at: https://doi.org/10.1088/1742-6596/1845/1/012027.

Warnilah, A.I. et al. (2020) ‘The Implementation of the MFEP (Multi Factor Evaluation Process) Method In Determining the Learning Model’, Journal of Physics: Conference Series, pp.1–8. Available at: https://doi.org/10.1088/1742-6596/1641/1/012036.

Wu, H. et al. (2022) ‘Research on Learning Evaluation of College Students Based on AHP and Fuzzy Comprehensive Evaluation’, Hindawi Computational Intelligence and Neuroscience, 2022, pp.1–8.

Yuniangga, R.A. (2020) ‘Proposal Design of Program Evaluation’, Jurnal Ilmiah Ilmu Pendidikan dan Sosial, 9(2), pp.163–171.