New human-computer interaction regulations for ship safe driving based on multi-mode data interconnection

. Based on the analysis of the multi-mode data of ship mechatronics and the new human-computer interaction regulations for safety driving, a new safety driving regulation based on multi-mode data is put forward. The new regulations for ship safe driving use mechanical and electrical data to form small-world data interconnection. Artificial intelligence and human-computer interaction operation information are used to integrate and communicate, and human-computer interaction data are incorporated to standardize driving behavior to integrate historical driving data, and finally, the standardized automatic self-driving is formed. The new human-computer interaction regulations formed by the safe driving system make it possible to solve and optimize the ship safe driving mode.


Introduction
The scale of ship navigation is expanding with the continuous development of the shipping industry, and water transportation is the most economical mode of transportation, but it also brings a series of safety issues. This highlights the necessity of establishing and standardizing new regulations for ship navigation in order to reduce the occurrence of navigation accidents. Specifically, the integrated driving behavior of human-computer interaction is constructed using ship equipment multi-mode data, detection and conversion technology, artificial intelligence application technology and driving mode, and thus, and combined with the data platform for data interconnection, intelligent analysis. Finally, the danger coefficient and the optimal navigation route are judged through optimization calculation and simulation, and the avoidance rules are generated automatically. In the design of human-computer interaction technology of ship safe driving multi-mode data, it is mainly supported by multi-mode data and human-computer interaction informatization to realize the standardization, automation and Informa ionization of ship safe driving. In this process, improves the safety performance and navigation quality of ship navigation, opens up new regulations for ship navigation, reflects the value of safe navigation and breaks the traditional navigation mode.

Technical framework of the new human-computer interaction regulations for ship safe driving
The ship safe driving human-computer interaction technology based on multi-mode data interconnection integrates multiple technologies, such as multi-mode data, detection and conversion, artificial intelligence application, to evaluate ship safe driving, and then control and intervene ships in a more reasonable manner. The multi-mode data interconnection technology establishes the ship big data platform through data collection during navigation, such as ship mechanical and electrical equipment, navigation environment, channel information, etc.. The data processing terminal intelligently analyzes the real-time information of ship navigation and forms a small local area network with a variety of ship data. The human-computer interaction procedure records the ship's driving habits through multi-mode data interconnection, processes and simulates the ship's route by the fusion of data and model, and then gives early warning and intervention to the ship. The new human-computer interaction regulation technology is composed of four layers: ship equipment layer, data layer, rule layer and application layer. The architecture diagram is shown in Fig. 1. First, the equipment layer. The ship equipment layer collects, retrieves and transmits the ship power equipment, auxiliary equipment, steering equipment, communication equipment and AIS information in real time through the ship mechanical and electrical equipment input terminal, navigation environment data input terminal and communication information input terminal.
Second, the data layer. The data layer mainly stores and processes multi-mode data, including mechanical and electrical equipment data, environmental data and channel information, channel data, driving habit data, etc., which is mainly completed by big data platform, multi-mode data interconnection technology. Realize the visualization and standardization of data server and ship information.
Third, the rule layer. The rule layer uses the data obtained from the data layer, calculates and simulates the ship navigation through the ship avoidance rules, obtains the ship risk coefficient, the optimal route and the rules of human-computer interaction, and establishes the ship safety early warning mode.
Fourth, the application layer. In the application layer, the fusion processing of ship multi-mode data and human-computer interaction rules is transformed into visual operation information, and the ship command is controlled through the human-computer interface to realize instruction input and output. For ship early warning and intervention, through interface display and voice broadcast, improve the safety and efficiency of navigation and promote the integrated development of safe driving environment.

3
Standardized construction of ship safe driving human-computer interaction technology

Small world multi-mode data interconnection of ship mechatronics
The ship is mainly composed of the hull, the ship power plant and the ship electrical. We first collect the mechanical and electrical data from the separate mechanical equipment, and deal with the block processing power plant, auxiliary equipment, steering device, communication equipment, AIS and so on in the equipment layer. The data are stored and input to the data processing terminal of the local area network. The data processing terminal interconnects with human-computer to intelligently analyze and process the data of mechanical and electrical equipment and sensors, iteratively optimize and feedback the ship data in real time, and construct the data environment ecosystem of ship electromechanical system.  Ship mechatronics integrates electromechanical data acquisition, information processing and intelligent monitoring to form multi-mode data interconnection technology. The ship electromechanical system uses sensors, control processing devices and electromechanical interfaces to collect information and output control commands. The real-time feedback data are sent to the SQL Server database, and the database extracts, integrates, maintains and converts the data. The electromechanical data on board are monitored, controlled and maintained remotely. After data comparison, data analysis and model calculation, the results and data are transmitted to the ship to complete the data interconnection in ship navigation. Ship mechatronics small world big data consists of three parts: ship mechanical and electrical equipment, ship data acquisition and ship information processing, a data synthesis server, an information processing terminal and multiple data acquisition terminals constitute a local area network. The data integration server cooperates with the information processing terminal to simplify, standardize and visualize the information management of ship big data. Combined with database and information for iterative optimization and real-time feedback, a complete data and information exchange ecosystem is formed in the ship.

Integrated safe driving system of artificial Intelligence and human-computer interaction
The former relies on the ship big data platform for data mining, machine learning driving behavior information, intelligent algorithm to analyze and learn the ship navigation information, to find the optimal navigation route and environment, to warn the ship danger, to intervene the ship. Multi-mode data are uploaded to SQL Server database for preservation by artificial intelligence, and a small local area network is formed to facilitate the driver to extract and view. At the same time, strengthen the detection of the hidden dangers of the waterway and its own safety, manage the collected data, simplify the ship operating system, feedback the ship's driving information through the human-computer interface and the system, and realize the human-computer integrated communication.
Artificial intelligence plus the integration of human-computer interaction, artificial intelligence is introduced into human-computer interaction to realize self-learning, self-optimization and self-adaptation, and make full use of the data information of multi-mode data integration data platform. Realize the functions of intelligent prediction, independent planning, intelligent intervention and intelligent control to make ship navigation automatic and intelligent. When there are obstacles, reefs or dangerous ships in the ship's driving area, through ideal analysis and understanding, establish a mathematical model to choose the best driving route, intervene in the ship's danger early warning, use sensors to operate the ship to avoid, strengthen the ship's intervention, and broadcast and manipulate through the human-computer interaction page to reduce the collision accidents caused by the driver's negligence. The human-computer interactive control interface displays the menu bar, electronic chart, basic equipment, shipping suggestions, user information, ship operation console, and the pilot can monitor and control the ship directly from the screen.
Human-computer interaction is based on the interconnection of ship information-system-human information. In the case of self-driving, the multi-mode data is collected automatically, analyzed and sorted repeatedly in the control system, the human-computer interaction platform is constructed, and artificial intelligence is configured. The human-computer interaction system imitates the historical safe operation behavior of the ship, transforms the operation command, and achieves the function of human-computer interaction integrated operation and safe driving control.

New regulations for human-computer interaction and automatic self-driving
The new human-computer interaction regulations for ship safe driving based on multi-mode data interconnection adopts the interconnection of data information, simulates navigation according to the rules of human-computer interaction, and carries on the early warning intervention to the ship. The new human-computer interaction regulations for ship safe driving include multi-mode data integration regulations, ship early warning regulations and   Figure 3 shows the operation standardization module of the ship safe driving human-computer interaction system. The perception module is responsible for obtaining the in-ship and out-of-ship data from the multi-mode mechatronics small world big data for monitoring, transmitting object information through the prediction module to establish a mathematical model, communicating information, establishing a ship management and control system, and generating a feasible locus. To meet the ship's own performance, waterway information constraints, the nature of obstacles to give specific speed and direction suggestions to the driver. Behavior decision-making and path planning can be intuitively understood as the ship's auxiliary navigation system, which is the result of routing, and directs the ship to travel and avoid at the macro level. The operation control module mainly controls the ship and forms safety measures by relying on artificial intelligence safe driving system identification. Ship decision-making mainly relies on Beidou system for real-time positioning, collecting channel information, predicting ship trajectory and ensuring ship safety.
Artificial intelligence + big data + electromechanical automation realizes the automatic operation of electromechanical equipment itself and promotes the automatic operation of driving safety control system. On the basis of automatic intervention of artificial intelligence, according to the technical performance and conditions of the new human-computer interaction regulations for ship safe driving, the self-driving design and optimize navigation data under the condition of ensuring the safety of ships.
It has the ability to automatically judge that the ship is a direct ship or give way ship, if the ship is a direct ship, then carry out simple automatic self-driving, the general system will not automatically take measures. If the risk of collision between the two ships reaches the highest, emergency collision avoidance measures will be carried out automatically. If the ship is a giving way ship, the advanced automatic self-driving will be carried out, and the system will take automatic evasion measures, and the relative orientation and course of the ship will remain unchanged until the giving way ship is cleared.

Application of new human-computer interaction regulations for ship safe driving
The real-time data monitoring of the conventional ship safe driving system is used to provide data support for the rational application of the new human-computer interaction regulations. Through the Beidou positioning to analyze the navigation parameters and display the monitoring results, and the navigation route of the two ships is monitored calculating the position of the two ships. D, R, L is the linear distance between the ship and WKH REVWDFOH DQG ș UHSUHVHQWV WKH DQJOH EHWZHHQ WKH VKLS DQG WKH VKLS So there is: Suppose that the coordinate of ship A is ‫ݔ(‬ , y ), the speed is V , the heading is ߠ , and the coordinate of ship B(‫ݔ‬ ଵ , ‫ݕ‬ ଵ ) , the speed is V ଵ , and the heading is ߠ ଵ . The coordinate of ship An is the coordinate of ship A, and the velocity of ship An is (xonomy 0). The relative velocities of the two ships are on the X axis, the components of the Y axis and the relative speed are as follows: To ensure the safe navigation of the two ships, select and calculate the distance between the two ships and the relative speed direction between the two ships, real-time monitor the position of the two ships, timely early warning and human-computer interaction intervention. Among them, the value of ܽ depends on the relative speed of the two ships on the X axis V ୖ୶ .
The risk of ship collision directly affects the decision-making of (ship safe driving) human-computer interaction in safe navigation of ships. DCPA (the distance between ship and obstacle), TCPA (time to the closest point) and DCPA (the distance between ship and obstacle) are selected as the indexes to construct the risk function of ship collision. The feasibility of ship-computer interaction is verified by real-time monitoring of human-computer interaction ship risk by calculating DCPA and TCPA, during ship operation.

Data verification of new human-computer interaction regulations
The work was supported by the project "Research on development and demonstration application of inland river green high-tech cargo ship" from Guangxi When the ship data is collected to the danger of the ship route, the monitoring distance and angle will be used to warn the ship, and when it reaches a certain limit, it will be connected to the ship automatic control system, interfere with the ship.  8kn  877m  620m  550m  510m  491m  488m  13kn  1560m  1254m  1153m  1032m  998m  980m  18kn  2453m  2036m  1950m  1880m  1560m  1480m  22kn  3350m  2950m  2648m  2460m  2065m  1930m   Table 3. The distance between the bow and the obstacle when generating the intervention. 0°  15°  30°  45°  60°  75°   8kn  300m  250m  230m  200m  --13kn  450m  410m  380m  320m  320m  -18kn  520m  460m  460m  430m  430m  430m  22kn 605m 570m 550m 550m 550m 550m By calculating the risk degree of the ship, the feasibility and stability of the ship human-computer interaction system are verified, and the ship human-computer interaction operation curve is obtained. First of all, collect the ship's own parameters such as heading, MATEC Web of Conferences 355, 03033 (2022) ICPCM2021 https://doi.org/10.1051/matecconf/202235503033 speed and weight, input them into the data synthesis server, and analyze the data of the unmanned navigation rules; secondly, generate early warning, intervention and unmanned navigation to the ship according to the unmanned navigation rules; finally, determine the position and driving risk of the ship, and verify the feasibility and stability of the human-computer interaction system.

Conclusion
With the multi-mode data of hull electromechanical data, historical driving data and navigation environment data, a new human-computer interaction regulation for ship safe driving based on multi-mode data interconnection is formed. The multi-mode data collects and records the ship's mechanical and electrical data, stores them on the Internet, judges whether the ship's equipment is faulty, interconnects with the human-computer, and records the driving data with multi-mode data. The system will judge the navigation environment according to the ship driving historical data and warn the dangerous environment in advance. Multi-mode data interconnection provides data verification for human-computer interaction and autopilot in a fixed channel, which promotes the development of a new mode in the shipbuilding industry.