Database and bigdata processing system for analysis of AIS messages in the netBaltic research project

• Autorzy: Lewczuk M. , Cichocki P. , Woźniak J.

Identyfikatory

DOI

10.17466/tq2017/21.4/a

• Języki publikacji: EN

Abstrakty

EN

A specialized database and a software tool for graphical and numerical presentation of maritime measurement results has been designed and implemented as part of the research conducted under the netBaltic project (Internet over the Baltic Sea – the implementation of a multi-system, self-organizing broadband communications network over the sea for enhancing navigation safety through the development of e-navigation services.) The developed software allows tracing graphs of radio-connections between shore stations and vessels (offshore units), based on historical data including the traffic of ships and their specific parameters collected on the Baltic Sea during the last four years. It also enables preparation of data for network simulation experiments using AIS (Automatic Identification of Ships) and GPS (Global Positioning System) loggers installed on shore stations and vessels, taking into account a number of input parameters, such as: time range, coast station selection, ship flags based on MMSI numbers and types and ranges of possible communication technologies used (WiFi, WiMax, Radwin, LTE,etc.). The created tool has a multi-layer architecture that utilizes the Maria DB SQL database, the Apache2 WEB server, and a number of PHP applications. The runtime environment has been built on Linux Debian version 8 and the HP C7000 cluster of the 16 CPU x86_64 architecture. The modularity of the application allows parallel processing and, therefore, optimization of the computing cluster. The database contains more than 70 million records which enables simulation of various topologies (with multi-hop transmissions) and network operations depending on the transmission techniques being used. The database is fully scalable, and allows easy adding of further data collected during subsequent measurement sessions. Additionally, the use of virtualization tools facilitates the future migration to more efficient processing environments, in case of a significant increase in the volume of data. The data recorded in the database allows calculation of statistics for the surveyed networks, and determining the incidence of potential network nodes (e.g. by flag) complete with their available communication techniques – information which is important in determining structures of possible multi-hop networks and their performance. The software finds routes for datagrams according to accepted criteria and exports results to a network traffic simulator, and as such is an important part of the framework used for planning next measurement campaigns and determining which communications equipment would be more suitable for vessels.

Słowa kluczowe

EN

AIS; NMEA data; Maria DB SQL database; cache mechanism; virtualization; net Baltic project

PL

AIS; dane NMEA; baza danych MariaDB SQL; mechanizm pamięci podręcznej; wirtualizacja; projekt sieci Baltic

• Wydawca: Politechnika Gdańska
• Czasopismo: TASK Quarterly : scientific bulletin of Academic Computer Centre in Gdansk
• Rocznik: 2017
• Tom: Vol. 21, No 4
• Strony: 321--331
• Opis fizyczny: Bibliogr. 15 poz., rys., tab.

Twórcy

autor

Lewczuk M.

• Faculty of the Electronics, Telecommunications and Informatics, Gdansk University of Technology, Narutowicza 11/12, 80-233 Gdansk, Poland

autor

Cichocki P.

• Faculty of the Electronics, Telecommunications and Informatics, Gdansk University of Technology, Narutowicza 11/12, 80-233 Gdansk, Poland

autor

Woźniak J.

• Faculty of the Electronics, Telecommunications and Informatics, Gdansk University of Technology, Narutowicza 11/12, 80-233 Gdansk, Poland

Bibliografia

• [1] IMO MSC 81/23/10 2005 Work Programme. Development of an e-Navigation strategy, submitted by Japan, Marshall Islands, the Netherlands, Norway, Singapore, the United Kingdom and the United States, International Maritime Organization
• [2] IMO NCSR Annex 7 2014 Draft e-navigation strategy implementation plan http://www.imo.org/en/OurWork/Safety/Navigation/Documents/enavigation/SIP
• [3] Zaidi K S, Jeoti V, Awang A 2013 Wireless backhaul for broadband communication over sea, Proc. IEEE 11th Malaysia International Conference on Comm. 298
• [4] Report on IALA Workshop 2016 Development of VHF Data Exchange System (VDES)
• [5] ITU RSG: IALA, e-NAV14-10.3.6 2013 Working Document toward a draft new Report Maritime Radiocommunication Systems and Requirements
• [6] Wozniak J, Gierlowski K, Hoeft M 2017 Broadband Communication Solutions for Maritime ITS s: Wider and Faster Deployment of New e-Navigation Services, 16th Intenational Conference on Intelligent Transportation System ( IEEE Xplore)
• [7] Hoeft M, Gierłowski K, Nowicki K, et al. 2016 netBaltic: Enabling Non-Satellite Wireless Communications over the Baltic Sea, IEEE Communications Magazine 05/2016 2
• [8] Kdouh H, Brousseau C, Zaharia G, et al. 2011 Measurements and path loss models for shipboard environments at 2.4 GHz, 41st European Microwave Conference 408
• [9] Yang K, Roste T, Bekkadal F, et al. 2011 Long-Distance Propagation Measurements of Mobile Radio Channel over Sea at 2 GHz, IEEE Vehicular Technology Conference (VTC Fall) 1
• [10] Roux Y M Le, Ménard J, Toquin C, et al. 2009 Experimental measurements of propagation characteristics for maritime radio links, 9th International Conference on Intelligent Transport Systems Telecommunications, (ITST) 364
• [11] ITU-R M. 2092 2015 Technical characteristics for a VHF data exchange system in the VHF maritime mobile band
• [12] Forouzan B 2006 Data Communications and Networking (Satellite Networks), 4th ed., The McGraw-Hill Companies
• [13] Zhou M T, et al. 2013 IEEE Wireless Communications 20 (5) 134
• [14] Lewczuk M, Cichocki P, Wozniak J 2016 Telecom. Review + Telecom. News 12 1326 (in Polish)
• [15] Lewczuk M, Cichocki P, Wozniak J 2016 Telecom. Review + Telecom. News 8-9 734 (in Polish)

Uwagi

PL

Opracowanie rekordu w ramach umowy 509/P-DUN/2018 ze środków MNiSW przeznaczonych na działalność upowszechniającą naukę (2018).