Design of a Data Collection System with Data Compression for Small Manufacturers in Industrial IoT Environments

Chunju Tsai, Wen Yueh Shih, Yi Shu Lu, Jiun Long Huang, Lo Yao Yeh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With advance of IoT (Internet of Things) technology, many manufacturers install several sensors to monitor the status of machines and the health of the whole manufacturing process. In addition, the sensed data are usually transmitted to a backend database for further analysis. However, the dramatic volume of data sensed by the sensors causes the problem of huge storage requirement and network traffic for the small medium manufacturers which have limited resource and budget in IT (Information Technology). To deal with this problem, we design a two-layered architecture using compression technique to reduce the network traffic. In addition, we use MongoDB, a NoSQL database, to store the compressed data due to MongoDB's excellent scale-out ability and cost-efficiency. We conduct several experiments to measure the performance of the proposed architecture with several compression methods. Experimental results show that with proper lossless compression method, the reduction ratio of the volume of the data is around 80% at the cost of slight increase in execution time.

Original languageEnglish
Title of host publication2019 20th Asia-Pacific Network Operations and Management Symposium
Subtitle of host publicationManagement in a Cyber-Physical World, APNOMS 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9784885523205
DOIs
StatePublished - Sep 2019
Event20th Asia-Pacific Network Operations and Management Symposium, APNOMS 2019 - Matsue, Japan
Duration: 18 Sep 201920 Sep 2019

Publication series

Name2019 20th Asia-Pacific Network Operations and Management Symposium: Management in a Cyber-Physical World, APNOMS 2019

Conference

Conference20th Asia-Pacific Network Operations and Management Symposium, APNOMS 2019
CountryJapan
CityMatsue
Period18/09/1920/09/19

Keywords

  • Compression
  • Data storage
  • Industrial IoT
  • IoT

Fingerprint Dive into the research topics of 'Design of a Data Collection System with Data Compression for Small Manufacturers in Industrial IoT Environments'. Together they form a unique fingerprint.

Cite this