Turkish Journal of Computer and Mathematics Education
Journal license

Journal

Turkish Journal of Computer and Mathematics Education


Volume
& Issue

Volume 10, Issue 2


Published
on

September 10, 2019


Pages

1187-1200


DOI

Article

Automated image classification for heritage photographs using Transfer Learning of Computer Vision in Artificial Intelligence


Authors

Viratkumar K. Kothari Affiliation:
Ph.D. Scholar, Kadi Sarva Vishwavidyalaya, Gandhinagar, Gujarat
and Dr Sanjay M. Shah Affiliation:
Director, Narsinhbhai Institute of Computer Studies & Management, Kadi, Gujarat


Abstract

There is substantial archival data available in different forms, including manuscripts, printed papers, photographs, videos, audio, artefacts, sculptures, buildings, and others. Media content like photographs, audio, and videos are crucial content because such content conveys information well. The digital version of such media data is essential as it can be shared easily, available on the online or offline platform, easy to copy, easy to transport, easy to back up, and easy to keep multiple copies in different places. The limitation of the digital version of media data is the lack of searchability, as it hardly has any text that can be processed for OCR. These important data cannot be analysed and, therefore, cannot be used in a meaningful way. To make this data meaningful, one has to manually identify people in the images and tag them to create metadata. Most of the photographs were possible to search based on very basic metadata. This data when hosted on the web platform, searching media data is becoming a challenge due to its data formats. Improvement in existing search functionality is required to improve the searchability of the photographs in terms of ease of usage, quick retrieval and efficiency. The recent revolution in machine learning, deep learning, and artificial intelligence offers a variety of facilities to process media data and identify meaningful information from it. This research paper explains the methods used to process digital photographs to classify people in the given photographs, tag them, and save that information in the metadata. We will tune various hyperparameters to improve their accuracy. Machine learning, deep learning, and artificial intelligence offer several benefits, including auto-identification of people, auto-tagging them, providing insights, and finally, the most important part is that it drastically improves the searchability of photographs.

It was envisaged that about 85% of the manual tagging activity might be reduced, and the searchability of photographs would be improved by 90%.


Keywords

Deep Learning, Transfer Learning, Convolutional Neural Networks, Image Classification, Image Processing, Machine Learning, Computer Vision


Citation

Kothari, V. K. & Shah, D. S. M. (2019). Automated image classification for heritage photographs using transfer learning of computer vision in artificial intelligence. Turkish Journal of Computer and Mathematics Education, 10(2), 1187–1200.

Published by: Engineering Journals

Engineering Journals Logo