Human–Artificial Intelligence Collaboration in Intelligent Information Systems for Supporting Organizational Decision-Making
DOI:
https://doi.org/10.59890/ijist.v4i10.75Keywords:
Human–AI Collaboration; Intelligent Information Systems; Decision Making; Artificial Intelligence; Case Studies.Abstract
The use of artificial intelligence in information systems is increasingly influencing organizational decision-making processes, but its effectiveness still depends on how humans understand, assess, and use AI-generated recommendations. This study aims to explore the pattern of human–AI collaboration in intelligent information systems and its contribution to organizational decision-making. The research uses a qualitative approach with a case study design. Data were collected through in-depth interviews with 15 managers, analysts, and users of AI-based information systems, then analyzed using thematic analysis. The results show that decision effectiveness is influenced by the human–AI role sharing, trust in the system, recommendation transparency, and user interpretation ability. The findings confirm the importance of system design that places AI as a support for human considerations in decision-making.
References
Berente, N., Gu, B., Recker, J., & Santhanam, R. (2021). Managing artificial intelligence. MIS Quarterly, 45(3), 1433–1450. https://doi.org/10.25300/MISQ/2021/16274
Braun, V., & Clarke, V. (2021). One size fits all? What counts as quality practice in (reflexive) thematic analysis? Qualitative Research in Psychology, 18(3), 328–352. https://doi.org/10.1080/14780887.2020.1769238
Braun, V., & Clarke, V. (2023). Is thematic analysis used well in health psychology? A critical review of published research, with recommendations for quality practice and reporting. Health Psychology Review, 17(4), 695–718. https://doi.org/10.1080/17437199.2022.2161594
Buschmeyer, K., Zenner, J., & Hatfield, S. (2024). Effectiveness of AI-based decision support systems in work environment: A systematic literature review. International Journal of Human Factors and Ergonomics, 11(5), 1–54. https://doi.org/10.1504/IJHFE.2024.142761
Byrne, D. (2022). A worked example of Braun and Clarke’s approach to reflexive thematic analysis. Quality & Quantity, 56(3), 1391–1412. https://doi.org/10.1007/s11135-021-01182-y
Cao, G., Duan, Y., Edwards, J. S., & Dwivedi, Y. K. (2021). Understanding managers’ attitudes and behavioral intentions towards using artificial intelligence for organizational decision-making. Technovation, 106, 102312. https://doi.org/10.1016/j.technovation.2021.102312
de Brito Duarte, R., Correia, F., Arriaga, P., & Paiva, A. (2023). AI trust: Can explainable AI enhance warranted trust? Human Behavior and Emerging Technologies, 2023, 4637678. https://doi.org/10.1155/2023/4637678
Eisbach, S., Langer, M., & Hertel, G. (2023). Optimizing human-AI collaboration: Effects of motivation and accuracy information in AI-supported decision-making. Computers in Human Behavior: Artificial Humans, 1(2), 100015. https://doi.org/10.1016/j.chbah.2023.100015
Fügener, A., Grahl, J., Gupta, A., & Ketter, W. (2022). Cognitive challenges in human–artificial intelligence collaboration: Investigating the path toward productive delegation. Information Systems Research, 33(2), 678–696. https://doi.org/10.1287/isre.2021.1079
Gómez, C., Unberath, M., & Huang, C.-M. (2023). Mitigating knowledge imbalance in AI-advised decision-making through collaborative user involvement. International Journal of Human-Computer Studies, 172, 102977. https://doi.org/10.1016/j.ijhcs.2022.102977
Hennink, M., & Kaiser, B. N. (2022). Sample sizes for saturation in qualitative research: A systematic review of empirical tests. Social Science & Medicine, 292, 114523. https://doi.org/10.1016/j.socscimed.2021.114523
Hillebrand, L., Raisch, S., & Schad, J. (2025). Managing with artificial intelligence: An integrative framework. Academy of Management Annals, 19(1), 343–375. https://doi.org/10.5465/annals.2022.0072
Jarrahi, M. H., Lutz, C., & Newlands, G. (2022). Artificial intelligence, human intelligence and hybrid intelligence based on mutual augmentation. Big Data & Society, 9(2). https://doi.org/10.1177/20539517221142824
Kolbjørnsrud, V. (2024). Designing the intelligent organization: Six principles for human-AI collaboration. California Management Review, 66(2), 44–64. https://doi.org/10.1177/00081256231211020
Lee, M. C. M., Scheepers, H., Lui, A. K. H., & Ngai, E. W. T. (2023). The implementation of artificial intelligence in organizations: A systematic literature review. Information & Management, 60(5), 103816. https://doi.org/10.1016/j.im.2023.103816
Leoni, L., Gueli, G., Ardolino, M., Panizzon, M., & Gupta, S. (2024). AI-empowered KM processes for decision-making: Empirical evidence from worldwide organisations. Journal of Knowledge Management, 28(11), 320–347. https://doi.org/10.1108/JKM-03-2024-0262
Microsoft & LinkedIn. (2024). 2024 Work Trend Index: AI at work is here. Now comes the hard part. https://www.microsoft.com/en-us/worklab/work-trend-index/ai-at-work-is-here-now-comes-the-hard-part
Peng, L., Li, D., Zhang, Z., Zhang, T., Huang, A., Yang, S., & Hu, Y. (2024). Human-AI collaboration: Unraveling the effects of user proficiency and AI agent capability in intelligent decision support systems. International Journal of Industrial Ergonomics, 103, 103629. https://doi.org/10.1016/j.ergon.2024.103629
Scharowski, N., Perrig, S. A. C., Svab, M., Opwis, K., & Brühlmann, F. (2023). Exploring the effects of human-centered AI explanations on trust and reliance. Frontiers in Computer Science, 5, 1151150. https://doi.org/10.3389/fcomp.2023.1151150
Storey, V. C., Hevner, A. R., & Yoon, V. Y. (2024). The design of human-artificial intelligence systems in decision sciences: A look back and directions forward. Decision Support Systems, 182, 114230. https://doi.org/10.1016/j.dss.2024.114230
Vincent, V. U. (2021). Integrating intuition and artificial intelligence in organizational decision-making. Business Horizons, 64(4), 425–438. https://doi.org/10.1016/j.bushor.2021.02.008
Wang, X., & Yin, M. (2022). Effects of explanations in AI-assisted decision making: Principles and comparisons. ACM Transactions on Interactive Intelligent Systems, 12(4), Article 27, 1–36. https://doi.org/10.1145/3519266
Wen, Y., Wang, J., & Chen, X. (2025). Trust and AI weight: Human-AI collaboration in organizational management decision-making. Frontiers in Organizational Psychology, 3, 1419403. https://doi.org/10.3389/forgp.2025.1419403
