Handbook of Intelligent Computing and Optimization for Sustainable Development. Группа авторов
Чтение книги онлайн.
Читать онлайн книгу Handbook of Intelligent Computing and Optimization for Sustainable Development - Группа авторов страница 47
Название: Handbook of Intelligent Computing and Optimization for Sustainable Development
Автор: Группа авторов
Издательство: John Wiley & Sons Limited
Жанр: Техническая литература
isbn: 9781119792628
isbn:
Figure 3.9 Average confidence score obtained by garments of interest of particular color at a confidence threshold of 0.60.
The distribution of the total duration of time for which the customers were interested in a garment of a given color at a confidence threshold (δ) of 0.6 is illustrated in Figure 3.10. This figure elucidates the distribution of the total time spent by the customers for each given color, thereby providing invaluable information about which color for a garment was most and least interacted with the customer base at the store.
3.4.3 Analysis of the Proposed Approach
It can be observed that the effectiveness of the proposed approach in detecting active garments depends on the foreground information extracted and the color masks applied subsequently. If the foreground information obtained after Stage 1 (refer to Figure 3.1) fails to capture an active garment, then the recall of the active garment detection is affected. Garments with consistent color and simple patterns were more accurately detected by the proposed approach as compared to garments with multiple colors and complex patterns. Active garments were partially detected in scenarios where the customer obstructed a major portion of the garment. The proposed approach was able to identify garments of interest well, especially when the garments and wrists of a customer are in clear view.
Figure 3.10 Total duration of time for which customers were interested in a garment of a given color at a confidence threshold of 0.60.
From the data displayed in Figures 3.9 and 3.10, we can make the following key observations:
1 1. Customers spent the most time interacting with various garments having shades of blue or green color, which they found to be the most interesting compared to other colors.
2 2. Shades of red-colored garments showed the highest average confidence score consistently for all values of confidence thresholds thereby indicating that there was maximum interaction with a red-colored garment whenever one was detected as an active garment.
3 3. Customers found garments having shades of orange color the least interesting and spent the least amount of time on such garments. This indicates that they had minimum interaction with such garments which is reflected by the garments’ lowest average confidence scores as well.
The main advantage of the proposed approach is that it is able to indicate which customer is interested in which garment from a surveillance video. However, its disadvantage is that it finds it difficult to identify garments of interest correctly in highly crowded scenarios either due to the partial or complete obstruction of the garments or due to the difficulty in detecting the wrists of a person if they are obstructed by a garment.
3.5 Highlights
In this section, we highlight the major findings of this study. We utilize the GMG background subtraction algorithm for extracting the foreground information capturing non-stationary garments from the video of a surveillance camera. Using this foreground information, we are able to detect the garment regions which are then clustered to obtain the entire garment. We leverage the Mask R-CNN framework to detect customers from its object detection performed for the “person” class. Subsequently, we obtain the wrist feature points of these customers using OpenPose human pose estimation framework. Using these pieces of information, we propose a quantitative metric, known as the confidence score, which indicates the degree to which a customer is interested in a given garment. We take the Euclidean distance between the centroid of a garment and the coordinates of the wrist feature points of a customer and use the area of the garment to calculate the confidence score for the given pair of customer and garment. We analyze the variation of the average confidence score of garments of interest with a confidence threshold to generate meaningful evaluations.
3.6 Conclusion and Future Works
In this chapter, a robust framework for the detection of garments of interest is proposed. By using a suitable background subtraction algorithm in conjunction with a person detection framework, the foreground information comprising of the garments is obtained. The application of individual color masks and morphological operations is used to obtain garment regions, which could contain multiple detected contours within the same garment. A garment linking process is utilized to link contours belonging to the same garment, thereby obtaining the active garments. The active garments that the customers find interesting, referred to as garments of interest, are obtained by utilizing a confidence score metric. This confidence score is calculated by finding the Euclidean distance between a customer’s wrist landmarks and an active garment and using the area of the active garment in the foreground of the video frames during sales interactions.
The framework was tested on a surveillance video dataset obtained from CCTV footage of an Indian garment store and was found to be effective as demonstrated by the high precision and recall values for the detection of active garments and the competence of confidence threshold in filtering garments of interest from the collection of active garments. Furthermore, the framework successfully tracked the duration for which a customer was interested in a specific garment of interest.
Additionally, we believe that a cogent extension in the future could be to utilize the posture of the head in addition to the line of sight information to improve the determination of the garments of interest for a given customer. Furthermore, visual customer demographics information can be determined from the person masks obtained to filter the garments of interest of different customer groups, enabling us to perform market segmentation. In supplement to the suggested improvements, a mapping between a given customer and the sales merchant can be established in order to determine the collection of garments of interest that are not always adjacent to the wrists of the customer in consideration.
Acknowledgements
The authors would like to express our gratitude to Aniruddha Joshi, Goutham Kanahasabai, and Keerthi Priyanka for giving us consent to extend their work and would like to thank Dr. Earnest Paul Ijjina (Assistant Professor in Department of Computer Science and Engineering, National Institute of Technology, Warangal) for his guidance while undertaking this research. Lastly, we thank our families for their constant moral support and encouragement.
References
1. СКАЧАТЬ