Utilization of Digital Image and Convolution Neural Network Algorithm in Customer Satisfaction Survey with Facial Expressions

Tri Andre Anu, Rika Rosnelly, Dedi Irawan, Progresif Bulolo, Ubaidullah Hasibuan

Abstract


The human face provides us with a lot of information about a person, and arguably the two most important pieces of information in a face are a person's identity and their emotional state. Judgments of identity and emotion facilitate social interactions. Services are a crucial part of the activities of all organizations, especially those in the service sector. Good services support customer satisfaction and ultimately impact the progress of the organization. The Convolutional Neural Network algorithm has become the most widely used neural architecture in various tasks, including image classification, audio pattern recognition, machine translation of text, and speech recognition. The data groups (angry, fearful, happy, neutral, sad, and surprised) tested with a threshold value of 30 epochs achieved a loss (error) accuracy of 1.5146 on the test data. The accuracy on the test data is 0.61. The proposed Convolutional Neural Network algorithm and digital image utilization achieved high accuracy performance to assist in evaluating a service-related field.


Keywords


Digital Image; Convolutional Neural Network; Customer Satisfaction; Facial Expression;

Full Text:

PDF

References


Ahlawat, S., Choudhary, A., Nayyar, A., Singh, S., & Yoon, B. (2020). Improved handwritten digit recognition using convolutional neural networks (Cnn). Sensors (Switzerland), 20(12), 1–18. doi: 10.3390/s20123344

Akhand, M. A. H., Roy, S., Siddique, N., Kamal, M. A. S., & Shimamura, T. (2021). Facial emotion recognition using transfer learning in the deep CNN. Electronics (Switzerland), 10(9). doi: 10.3390/electronics10091036

Alamsyah, D., & Pratama, D. (2020). DATASET. Jurnal Teknologi Informasi, 4(2).

Anwar, K., & Setyowibowo, S. (2021). Segmentasi Kerusakan Daun Padi pada Citra Digital. Jurnal Edukasi Dan Penelitian Informatika (JEPIN), 7(1), 39. doi: 10.26418/jp.v7i1.42331

Badar, D. S., & Karsiwan, W. (2021). Survey Kepuasan Mahasiswa Atas Layanan Manajemen Pendidikan di STKIP Muhammadiyah Bogor Tahun 2020. Jurnal Educatio FKIP UNMA, 7(1), 182–188. doi: 10.31949/educatio.v7i1.910

Bhatt, D., Patel, C., Talsania, H., Patel, J., Vaghela, R., Pandya, S., Modi, K., & Ghayvat, H. (2021). Cnn variants for computer vision: History, architecture, application, challenges and future scope. In Electronics (Switzerland) (Vol. 10, Issue 20). MDPI. doi: 10.3390/electronics10202470

Chen, C.-F., Panda, R., Ramakrishnan, K., Feris, R., Cohn, J., Oliva, A., & Fan, Q. (n.d.). Deep Analysis of CNN-based Spatio-temporal Representations for Action Recognition. Retrieved from https://github.com/IBM/action-

Fakultas, S. R., Informasi, T., Islam, U., Muhammad, K., & Al Banjari, A. (2020). PENGOLAHAN CITRA DIGITAL DAN HISTOGRAM DENGAN PHYTON DAN TEXT EDITOR PHYCHARM. In Technologia (Vol. 11, Issue 3).

Fu’adah, Y. N., Pratiwi, N. C., Pramudito, M. A., & Ibrahim, N. (2020). Convolutional Neural Network (CNN) for Automatic Skin Cancer Classification System. IOP Conference Series: Materials Science and Engineering, 982(1). doi: 10.1088/1757-899X/982/1/012005

Khan, M. H. M., Boodoo-Jahangeer, N., Dullull, W., Nathire, S., Gao, X., Sinha, G. R., & Nagwanshi, K. K. (2021). Multi- class classification of breast cancer abnormalities using Deep Convolutional Neural Network (CNN). PLoS ONE, 16(8 August 2021). doi: 10.1371/journal.pone.0256500

Kim, G., Choi, I., Li, Q., & Kim, J. (2021). Article a cnn-based advertisement recommendation through real-time user face recognition. Applied Sciences (Switzerland), 11(20). doi: 10.3390/app11209705

Noyes, E., Davis, J. P., Petrov, N., Gray, K. L. H., & Ritchie, K. L. (2021). The effect of face masks and sunglasses on identity and expression recognition with super-recognizers and typical observers. Royal Society Open Science, 8(3). doi: 10.1098/rsos.201169

Rere, L. M. R., Usna, S., & Soegijanto, D. (2019). Studi Pengenalan Ekspresi Wajah Berbasis Convolutional Neural Network. Seminar Nasional Teknologi Informasi Dan Komunikasi STI&K (SeNTIK), 3.

Said, Y., Barr, M., & Ahmed, H. E. (2020). Design of a Face Recognition System based on Convolutional Neural Network (CNN). In Technology & Applied Science Research (Vol. 10, Issue 3). Retrieved from www.etasr.com

Sari Hutagalung, F., & Maulana, H. (2023). THE ACCURACY OF MAPE MODEL ON CNN TO CLASSIFICATION OF MOVING OBJECT. Journal of Theoretical and Applied Information Technology, 15(3). Retrieved from www.jatit.org

Zhu, F., Gong, R., Yu, F., Liu, X., Wang, Y., Li, Z., Yang, X., & Yan, J. (n.d.). Towards Unified INT8 Training for Convolutional Neural Network.




DOI: https://doi.org/10.30596/jcositte.v4i2.15915

Refbacks

  • There are currently no refbacks.