INTELLIGENT DECISION SUPPORT SYSTEMS FOR IDENTIFICATION OF CULTURAL VALUES: MODERN APPROACHES AND DEVELOPMENT PROSPECTS

Authors

  • A. Martynenko

DOI:

https://doi.org/10.34185/1562-9945-5-166-2026-19

Keywords:

intelligent decision support system, cultural values, cultural heritage, Knowledge Graph, Graph Neural Networks, GAT, R-GCN, Vision Transformer, deep learning, multimodal systems, Explainable AI, self-supervised learning

Abstract

The relevance of the research is determined by the rapid digitalization of cultural heritage, the growing volume of digital images, textual descriptions, metadata, and the increasing need for accurate, adaptive, scalable, and explainable automated identification and classification of cultural heritage objects. The problem addressed in the study is the limited effectiveness of traditional and partially integrated approaches based on k-NN, manually designed descriptors, convolutional neural networks, and static knowledge graph representations when processing heterogeneous, incomplete, and semantically complex cultural heritage data. The purpose of the research is to analyze modern approaches to intelligent decision support systems for cultural heritage identification and to substantiate an improved multimodal architecture capable of integrating visual, textual, and semantic information. The research methods include comparative analysis of existing approaches, analysis and generalization of previous research results, conceptual modeling, and evaluation of modern deep learning, multimodal learning, and graph-based methods. Particular attention is given to Graph Neural Networks, Graph Attention Networks (GAT), Relational Graph Convolutional Networks (R-GCN), Vision Transformers, BERT-based language models, self-supervised learning, and Explainable AI. The results demonstrate that replacing static graph representation methods with GAT and R-GCN enables more effective consideration of relationship types and weights, contextual information, and incomplete or noisy data. A multimodal architecture integrating Vision Transformer for image processing, a BERT-based model for textual information, and GNNs for Knowledge Graph representation is proposed. Their integration into a shared embedding space enables cross-modal analysis, semantic search, and zero-shot and few-shot classification. The study concludes that the transition from isolated classification models to integrated multimodal intelligent decision support systems can significantly improve the accuracy, robustness, adaptability, and interpretability of cultural heritage identification. Further research should focus on adaptive decision-making, self-supervised learning, Explainable AI, automatic Knowledge Graph enrichment, integration with national and international cultural heritage databases, human-in-the-loop approaches, and federated learning.

References

1. Martynenko A.A., Tevyashev A.D., Kulishova N.E., Moroz B.I., Sergienko A.S. "AUTOMATIC CLASSIFICATION OF PAINTINGS BY YEAR OF CREATION". Radio Electronics, Computer Science, Control. 2022. № 2 – P.80 – 89. DOI: https://doi.org/10.15588/1607-3274-2022-2-8

2. A.A. Martynenko, A.D. Tevyashev, N.E. Kulishova, B.I. Moroz. "SYSTEM ANALYSIS OF THE PROBLEM OF ESTABLISHING THE AUTHENTICITY AND AUTHORITY OF PAINTING WORKS". System Research & Information Technologies, 2022, № 1 – P.50 – 60. DOI: https://doi.org/10.20535/SRIT.2308-893.2022.1.04

3. A.A. Martynenko, A.D. Tevyashev, N.E. Kulishova, B.I. Moroz. "THE PROBLEM OF AUTOMATIC CLASSIFICATION OF PICTURES USING AN INTELLIGENT DECISION-MAKING SYSTEM BASED ON THE KNOWLEDGE GRAPH AND FINE-GRAINED IMAGE ANALYSIS". System Research & Information Technologies, 2022, № 4 – P.58 – 67. DOI: https://doi.org/10.20535/SRIT.2308-893.2022.4.05

4. Martynenko, Andrii. "METHODS AND MODELS OF ORGANIZATION AND PROCESSING OF DATA AND KNOWLEDGE IN AN INTELLIGENT DECISION SUPPORT SYSTEM FOR THE IDENTIFICATION OF CULTURAL VALUES." Scientific Collection «InterConf+» 32 (151) (2023): 652-661. DOI: https://doi.org/10.51582/interconf.19-20.04.2023.070

5. Martynenko, А., Moroz, В., Нulinа, I., & Syrotkina, О. (2020). Conceptual model of an intelligent decision support system to identify cultural values. COMPUTER-INTEGRATED TECHNOLOGIES: EDUCATION, SCIENCE, PRODUCTION, (40), 51-57. DOI: https://doi.org/10.36910/6775-2524-0560-2020-40-08

6. Ju F. Mapping the Knowledge Structure of Image Recognition in Cultural Heritage. Jour-nal of Imaging, 2024. DOI: https://doi.org/10.3390/jimaging10110272

7. Knowledge Graph-based Image Classification. Data & Knowledge Engineering, 2024. DOI: https://doi.org/10.1016/j.datak.2024.102285

8. Xia Lixin, Chen Huan, Li Xueman, Zhai Shanshan. Research on the Construction Method of Intangible Cultural Heritage Cross-modal Knowledge Graph Based on Image and Text Da-ta[J]. Information and Documentation Services, 2024, 45(5): 73-81 https://doi.org/10.12154/j.qbzlgz.2024.05.008

9. Xu X., Xu H. Big Data-driven Knowledge Graph Construction for Intangible Cultural Her-itage. Applied Mathematics and Nonlinear Sciences, 2025. DOI: https://doi.org/10.2478/amns-2025-1123

10. Martynenko, A., Prykhodchenko, S., Нulina I., & Moroz, D. (2024). Requirements and their implementation for an intelligent decision-making system for the identification and clas-sification of objects of cultural value.COMPUTER-INTEGRATED TECHNOLOGIES: EDUCATION, SCIENCE, PRODUCTION, (56), 311-324. https://doi.org/10.36910/6775-2524-0560-2024-56-48

11. Martynenko, A. A., B. I. Moroz, and I. G. Hulina. "Data Warehouse of Decision Support System for Identification of Cultural Property." XV International Conference on Information Technology Use in Education, Science and Industry. Dnipro. 2019.

12. Li W., Wang Z. Knowledge Graph for Cultural Heritage Digital Innovation. Communica-tions in Humanities Research, 2024. DOI: https://doi.org/10.54254/2753-7064/34/20240126

13. Huang R. et al. Knowledge Graph for Traditional Cultural Heritage. Frontiers in Sustain-able Development, 2023.DOI: https://doi.org/10.54691/fsd.v3i10.5669

14. ISO 21127:2023 Information and documentation – A reference ontology for the inter-change of cultural heritage information

15. Chen, L.; Li, J.; Cai, Q.; Han, X.; Ma, Y.; Xie, X. CMKG: Construction Method of Knowledge Graph for Image Recognition. Mathematics 2023, 11, 4174. https://doi.org/10.3390/math11194174

16. Garcia N. et al. Leveraging Knowledge Graphs and Deep Learning for automatic art analysis. Knowledge-Based Systems, 2022.

17. El Vaigh C. B. et al. GCNBoost: Artwork Classification by Label Propagation through a Knowledge Graph. ICMR, 2021.

18. Franck Anaël Mbiaya, Christel Vrain, Frédéric Ros, Thi-Bich-Hanh Dao, and Yves Lu-cas. 2024. Knowledge graph-based image classification. Data Knowl. Eng. 151, C (May 2024). https://doi.org/10.1016/j.datak.2024.102285

19. Athanasios Efthymiou, Stevan Rudinac, Monika Kackovic, Marcel Worring, and Na-choem Wijnberg. 2021. Graph Neural Networks for Knowledge Enhanced Visual Repre-sentation of Paintings. In Proceedings of the 29th ACM International Conference on Multi-media (MM '21). Association for Computing Machinery, New York, NY, USA, 3710–3719. https://doi.org/10.1145/3474085.3475586

Downloads

Published

2026-10-30