Yel, İ.Baysal, M.E.Sarucan, A.2023-11-112023-11-11202397830313977692367-3370https://doi.org/10.1007/978-3-031-39777-6_53https://hdl.handle.net/20.500.13091/4763Intelligent and Fuzzy Systems - Intelligence and Sustainable Future Proceedings of the INFUS 2023 Conference -- 22 August 2023 through 24 August 2023 -- -- 299549In today's world, where many people use the outputs of the Information Technologies (IT) industry, it has become a problem for large-scale organizations to compare their IT departments objectively. The use of fuzzy MCDM methods for such a multidimensional problem is evaluated within the scope of this study. As a first step, twenty KPIs were determined by literature review and expert opinion to evaluate organizational units. Subsequently, KPI selection criteria were defined based on the opinions of ten expert personnel working in Architecht Information Systems for the selection of the most appropriate KPIs. These criteria are weighted by the fuzzy AHP method. Eight of the KPIs over the Neutrosophic Z Number (NZN) sets were selected for comparison by the same experts. Four different organizations were ranked by scoring over eight KPIs. It has been confirmed that the results of objective evaluations, instead of subjective evaluations, are more embraced by employees and managers, according to the outputs of the common sense and the infrastructural suitability of the institution. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.eninfo:eu-repo/semantics/closedAccessFuzzy MCDMIT OrganizationsKPI SelectionBenchmarkingInformation systemsInformation useExpert opinionFuzzy MCDMInformation technology departmentsInformation technology industryInformation technology organizationInformation technology sectorKPI selectionLarge-scalesLiterature reviewsMultidimensional problemsHuman resource managementConference Object10.1007/978-3-031-39777-6_532-s2.0-85172726196