Automated shopping system using computer vision

Date

2020-11-01

Author

Odeh, Nemer
Direkoglu, Cem

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

511
views

0
downloads

The shopping experiment made by amazon go in USA is one of the most interesting applications of computer vision recently. They allow you to shop and automatically charge your virtual card for whatever goods you purchased using cameras and wireless systems, so no checkouts or waiting lines are required. However, amazon didn't reveal yet the details of how their system components are implemented. In this paper, we introduce a complete system for computer vision based automated shopping. The proposed system contains barcode scanning of objects, data registration, image capturing for offline training stage, motion (change) detection, CNN and SVM for object classification and charging/discharging customers. Our system can be integrated with the wireless data transmission to do the whole shopping process. First, the proposed method extracts the objects' barcodes to register their details, and take sample images of objects for classifier training. We employ a pre-trained CNN (i.e. ResNet50) for feature extraction and a multi-class SVM for training. After training our classifier, we have a real-time operation stage (i.e. test stage). We assume that a camera is embedded above products on each shelf to capture videos of the products. We employ a change detector to understand any added or removed items. If the item is removed from or added to the shelve, the moving object is input to CNN feature extractor, and then SVM classifier for identification and pricing. Results show that the proposed system is fast and effective.

Subject Keywords

Media Technology, Computer Networks and Communications, Hardware and Architecture, Software

URI

https://hdl.handle.net/11511/65095

Journal

MULTIMEDIA TOOLS AND APPLICATIONS

DOI

https://doi.org/10.1007/s11042-020-09481-6

Collections

Engineering, Article

Suggestions

OpenMETU
Core

SWARM-based data delivery in Social Internet of Things Hasan, Mohammed Zaki; Al-Turjman, Fadi (Elsevier BV, 2019-03-01) Social Internet of Things (SIoTs) refers to the rapidly growing network of connected objects and people that are able to collect and exchange data using embedded sensors. To guarantee the connectivity among these objects and people, fault tolerance routing has to be significantly considered. In this paper, we propose a bio-inspired particle multi-swarm optimization (PMSO) routing algorithm to construct, recover and select k-disjoint paths that tolerates the failure while satisfying quality of service (QoS) ...
Cognitive-Node Architecture and a Deployment Strategy for the Future WSNs Al-Turjman, Fadi (Springer Science and Business Media LLC, 2019-10-01) The advent of sensing and communication technologies represents the next step in the evolution of wireless sensor networks (WSNs) and future applications. Future WSNs systems demand that connected devices could be able to work autonomously, while surfing on-line generated data and process them for self-decision making. Accordingly, we propose a cognitive Information-Centric Sensor Network (ICSN) framework. The fundamentals of cognition in ICSN can be recognized as a promising direction in addressing opportu...
Graph-based multilevel temporal video segmentation Sakarya, Ufuk; TELATAR, ZİYA (Springer Science and Business Media LLC, 2008-11-01) This paper presents a graph-based multilevel temporal video segmentation method. In each level of the segmentation, a weighted undirected graph structure is implemented. The graph is partitioned into clusters which represent the segments of a video. Three low-level features are used in the calculation of temporal segments' similarities: visual content, motion content and shot duration. Our strength factor approach contributes to the results by improving the efficiency of the proposed method. Experiments sho...
Efficient active rule processing in wireless multimedia sensor networks Oztarak, Hakan; Akkaya, Kemal; Yazıcı, Adnan; Sarisaray-Boluk, Pinar (Inderscience Publishers, 2016-01-01) Due to limited energy resources in wireless multimedia sensor networks (WMSNs), there is a need to perform data reduction and elimination over raw video data at the camera sensors before transmission. Nonetheless, this data reduction and elimination may create imprecision and uncertainty in the data, reducing the quality of decision making. In this paper, we propose a reactive mechanism for not only fusing uncertain data at the sink but also for automated processing of data using active rules, extending the...
Energy efficient wireless unicast routing alternatives for machine-to-machine networks Tekbiyik, Neyre; Uysal, Elif (Elsevier BV, 2011-09-01) Machine-to-machine (M2M) communications is a new and rapidly developing technology for large-scale networking of devices without dependence on human interaction. Energy efficiency is one of the important design objectives for machine-to-machine network architectures that often contain multihop wireless subnetworks. Constructing energy-efficient routes for sending data through such networks is important not only for the longevity of the nodes which typically depend on battery energy, but also for achieving a...

Citation Formats

N. Odeh and C. Direkoglu, “Automated shopping system using computer vision,” MULTIMEDIA TOOLS AND APPLICATIONS, pp. 30151–30161, 2020, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/65095.