International Journal of Information Technology and Computer Science (IJITCS)
IJITCS Vol. 13, No. 4, 8 Aug. 2021
Cover page and Table of Contents: PDF (size: 172KB)
SBIoT: Scalable Broker Design for Real Time Streaming Big Data in the Internet of Things Environment
Full Text (PDF, 172KB), PP.47-52
Views: 0 Downloads: 0
Author(s)
Halil ARSLAN
1,*
Mustafa YALCIN
2
Yasin SAHAN
2
Index Terms
Internet of Things, Big Data, Broker, Scaling, IoT
Abstract
Thanks to the recent development in the technology number of IoT devices increased dramatically. Therefore, industries have been started to use IoT devices for their business processes. Many systems can be done automatically thanks to them. For this purpose, there is a server to process sensors data. Transferring these data to the server without any loss has crucial importance for the accuracy of IoT applications. Therefore, in this thesis a scalable broker for real time streaming data is proposed. Open source technologies, which are NoSql and in-memory databases, queueing, full-text index search, virtualization and container management orchestration algorithms, are used to increase efficiency of the broker. Firstly, it is planned to be used for the biggest airport in Turkey to determine the staff location. Considering the experiment analysis, proposed system is good enough to transfer data produced by devices in that airport. In addition to this, the system can adapt to device increase, which means if number of devices increasing in time, number of nodes can be increased to capture more data.
Cite This Paper
Halil ARSLAN, Mustafa YALCIN and Yasin ŞAHAN, "SBIoT: Scalable Broker Design for Real Time Streaming Big Data in the Internet of Things Environment", International Journal of Information Technology and Computer Science(IJITCS), Vol.13, No.4, pp.47-52, 2021. DOI:10.5815/ijitcs.2021.04.05
Reference
[1] Tahmasib Fataliyev, Shakir Mehdiyev. “Industry 4.0: The Oil and Gas Sector Security and Personal Data Protection", International Journal of Engineering and Manufacturing, Vol.10, No.1, pp.1-14, 2020.
[2] Audrius Urbonavicius, Nagham Saeed. " IoT Leak Detection System for Building Hydronic Pipes ", International Journal of Engineering and Manufacturing, Vol.9, No.5, pp.1-21, 2019.
[3] Palle Divya Vani, Kanchi Raghavendra Rao, "Implementation of Smart Agriculture using CloudIoT and its Geotagging on Android Platform", International Journal of Engineering and Manufacturing, Vol.9, No.2, pp.43-53, 2019.
[4] Syed Kashan Ali Shah, Waqas Mahmood, " Smart Home Automation Using IOT and its Low Cost Implementation ", International Journal of Engineering and Manufacturing, Vol.10, No.5, pp.28-36, 2020.
[5] Yiming Xu, V. Mahendran, and S. Radhakrishnan, ‘Towards SDN-based fog computing: MQTT broker virtualization for effective and reliable delivery’, in 2016 8th International Conference on Communication Systems and Networks (COMSNETS), Jan. 2016, pp. 1–6, doi: 10.1109/COMSNETS.2016.7439974.
[6] ‘Thinger.IO’, Thinger.IO. https://console.thinger.io/#!/login.
[7] L. Roderick, ‘Discipline and Power in the Digital Age: The Case of the US Consumer Data Broker Industry’, Crit. Sociol., vol. 40, no. 5, pp. 729–746, Sep. 2014, doi: 10.1177/0896920513501350.
[8] A. M. Manasrah, T. Smadi, and A. ALmomani, ‘A Variable Service Broker Routing Policy for data center selection in cloud analyst’, J. King Saud Univ. - Comput. Inf. Sci., vol. 29, no. 3, pp. 365–377, Jul. 2017, doi: 10.1016/j.jksuci.2015.12.006.
[9] B. Cheng, S. Longo, F. Cirillo, M. Bauer, and E. Kovacs, ‘Building a Big Data Platform for Smart Cities: Experience and Lessons from Santander’, in 2015 IEEE International Congress on Big Data, Jun. 2015, pp. 592–599, doi: 10.1109/BigDataCongress.2015.91.
[10] C. Dobre and F. Xhafa, ‘Intelligent services for Big Data science’, Future Gener. Comput. Syst., vol. 37, pp. 267–281, Jul. 2014, doi: 10.1016/j.future.2013.07.014.
[11] C. N. Nguyen, J. Lee, S. Hwang, and J.-S. Kim, ‘On the role of message broker middleware for many-task computing on a big-data platform’, Clust. Comput., vol. 22, no. 1, pp. 2527–2540, Jan. 2019, doi: 10.1007/s10586-018-2634-9.
[12] P. Jutadhamakorn, T. Pillavas, V. Visoottiviseth, R. Takano, J. Haga, and D. Kobayashi, ‘A scalable and low-cost MQTT broker clustering system’, in 2017 2nd International Conference on Information Technology (INCIT), Nov. 2017, pp. 1–5, doi: 10.1109/INCIT.2017.8257870.
[13] R. Kawaguchi and M. Bandai, ‘A Distributed MQTT Broker System for Location-based IoT Applications’, in 2019 IEEE International Conference on Consumer Electronics (ICCE), Jan. 2019, pp. 1–4, doi: 10.1109/ICCE.2019.8662069.
[14] A. Raj and P. S. Kumar, ‘Branch Sequencing Based XML Message Broker Architecture’, in 2007 IEEE 23rd International Conference on Data Engineering, Apr. 2007, pp. 656–665, doi: 10.1109/ICDE.2007.367911.
[15] P. Rathod, D. Sharma, and A. Golhani, ‘A topic-based publish-subscribe message broker for SCADA system using hierarchical subscription handling’, in 2017 International Conference on Advances in Computing, Communication and Control (ICAC3), Dec. 2017, pp. 1–10, doi: 10.1109/ICAC3.2017.8318758.
[16] Z. Kelemen, ‘Airport information system integration by using message broker’, Period. Polytech. Transp. Eng., vol. 37, no. 1–2, Art. no. 1–2, Nov. 2009, doi: 10.3311/pp.tr.2009-1-2.03.
[17] E. Badidi, ‘Towards a Message Broker Based Platform for Real-Time Streaming of Urban IoT Data’, in Computational and Statistical Methods in Intelligent Systems, Cham, 2019, pp. 39–49, doi: 10.1007/978-3-030-00211-4_5.
[18] W. Pipatsakulroj, V. Visoottiviseth, and R. Takano, ‘muMQ: A lightweight and scalable MQTT broker’, in 2017 IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN), Jun. 2017, pp. 1–6, doi: 10.1109/LANMAN.2017.7972165.
[19] ‘RabbitMQ’, RabbitMQ, 2020. https://www.rabbitmq.com/.
[20] ‘MongoDB’, MongoDB, 2020. https://www.mongodb.com/.
[21] ‘Redis’, Redis, 2020. https://redis.io/.
[22] ‘ElasticSearch’, ElasticSearch, 2020. https://www.elastic.co/.
[23] ‘Docker’, Docker. https://www.docker.com/.
[24] D. Bernstein, ‘Containers and Cloud: From LXC to Docker to Kubernetes’, IEEE Cloud Comput., vol. 1, no. 3, pp. 81–84, Sep. 2014, doi: 10.1109/MCC.2014.51.
[25] ‘Kubernetes’, Kubernetes, 2020. https://kubernetes.io/.
[26] R. Chen and J. S. Liu, ‘Mixture Kalman filters’, J. R. Stat. Soc. Ser. B Stat. Methodol., vol. 62, no. 3, pp. 493–508, 2000, doi: https://doi.org/10.1111/1467-9868.00246.
[27] M. A. Mahmud, A. Abdelgawad, K. Yelamarthi, and Y. A. Ismail, ‘Signal processing techniques for IoT-based structural health monitoring’, in 2017 29th International Conference on Microelectronics (ICM), Dec. 2017, pp. 1–5, doi: 10.1109/ICM.2017.8268825.
[28] ‘Thingstream’, Thingstream. https://portal.thingstream.io/?returnUrl=%2Fapp%2Fshop.