Frontiers in Business, Economics and Management ISSN: 2766-824X | Vol. 13, No. 1, 2024 174 The Application Value of Human‐Vehicle Interaction Theory in Intelligent Cockpit Design Jun Tan, Weisheng He China Auto Information Technology (Tianjin), Co.,Ltd, China Abstract: With the rapid development of intelligent cockpit, the frontier research of human-vehicle interaction issues has gradually become the focus of the automobile industry. This paper introduces the development history of intelligent cockpit and its design principles and outlook also be proposed. Given the crucial role of multimodal interaction on the intelligent cockpit usability, its definition, common forms, challenges and solutions are introduced and discussed. Four conclusions are drawn from this paper. First of all, the intelligent cockpit design is combined with artificial intelligence technology to improve the convenience and safety of driving. Secondly, the multi-modal interaction provides drivers with a more natural and intuitive interaction mode, and increases the fun of driving. Moreover, the emotional design makes the car not only a means of transportation, but also a kind of emotional sustenance, which meets the emotional needs of users. Finally, the personalized experience allows users to customize the various functions of the car according to their own preferences and habits, which improves the driving comfort. These cutting-edge research not only promotes the technological progress of the automotive industry, but also provides new ideas and directions for the future automotive design. Keywords: Human-vehicle interaction; User experience; Intelligent cockpit design; Multi-modal interaction. 1. Introduction With the progress of science and technology, customer's expectations and demands for cars are constantly evolving. They are no longer only satisfied with the basic travel needs, but pursue more intelligent, comfortable and personalized driving experience. In the context of today's digital and intelligent era, the modes of human-vehicle interaction have become the key factors which affect customer’s purchase decisions and final user experience. Therefore, the cutting- edge research of human-vehicle interaction is of great significance for promoting the development and innovation of the automobile industry. The purpose of this study is to deeply explore the latest research results of human-vehicle interaction theory, including the frontier research on intelligent cockpit design, multi-modal interaction, and the consideration of design process concerning emotional needs and personalized experience. By systematically combing and summarizing relevant theories and practices, we will provide valuable references and inspiration for automotive designers, engineers and researchers, so as to promote the further development and application of human-vehicle interaction theory. 2. Intelligent Cockpit Design 2.1. Development process of intelligent cockpit Intelligent cockpit is an important part of the car cabins featured comprehensive intelligence and its development process can be traced back to the early automobile design. With the progress of science and technology, intelligent cockpit has evolved from traditional cockpit to digital cockpit, and then to intelligent cockpit. In the traditional cockpit stage, the interior design of the car mainly focuses on mechanical and physical equipment, such as the instrument panel, steering wheel, seats, etc. The cockpit design at this stage is mainly to meet the basic driving needs, and the interaction mode is relatively simple. With the emergence of digital technology, the cockpit began to develop to the digital cockpit. By introducing electronic devices and digital interfaces, the digital cockpit improves the convenience and safety of driving. For example, digital dashboards, navigation systems and entertainment systems make it easier for drivers to access information and control functions. However, there are still some limitations and deficiencies in the digital cockpit, such as high operation complexity, high frequency of click failure, poor visibility of information. Therefore, the concept of intelligent cockpit began to appear and gradually become a research hotspot. Through the integration of artificial intelligence, the Internet of Things, big data and other technologies, the intelligent cockpit realizes a more intelligent, personalized, natural, and comfortable interior environment. The intelligent cockpit can be adjusted according to the driver's habits and needs, providing more intelligent interaction and information presentation. In short, the development process of intelligent cockpit is a process of constantly pursuing more intelligent, comfortable and personalized driving experience. With the continuous progress of technology, the intelligent cockpit still has a lot of development space and application potential in the future. 2.2. Design principles of the intelligent cockpit According to the theories of human-computer interaction and user experience fields, the interaction between driver and intelligent cockpit play a crucial role on usability of intelligent cockpit. User characteristics, technical feasibility and safety requirement are needed to be taken into consideration in the research and development processes of intelligent cockpit. Here are some of the key design principles: User-centered design: The design of intelligent cockpit should focus on user cognition, provide intuitive and easy-to- use interface and interactive mode, and reduce user learning cost and operation complexity. At the same time, the intelligent cockpit should have personalized characteristics, which should be adjusted according to the preferences and 175 habits of different users to provide personalized driving experience. Expansibility: Smartphone, as intelligent terminal with a variety of high-tech integration, carry abundant information and offer a mobile platform for user to interact with others. The intelligent cockpit should not merely adopt advanced technology and intelligent algorithm to realize the efficient processing and intelligent push of information, but also achieve the joint use with smartphone. At the same time, keep the technology forward-looking and innovative, leaving space for the future function expansion and upgrade. Safety: Driving safety is the most basic needs for every users. The design of the intelligent cockpit must attach great importance to safety to ensure that the driver will not be disturbed or misoperation during use. In an emergency, the intelligent cockpit should provide a fast and accurate response to ensure the safety of the driver. Sustainability: The intelligent cockpit should be designed to consider environmental sustainability, using environmentally friendly materials and energy-saving technologies to reduce the impact of vehicles on the environment. In addition, the smart cockpit should be upgradable and maintainable to facilitate functional expansion and repair. The design principles of the intelligent cockpit are multifaceted, which requires a comprehensive consideration of user features, technical feasibility, safety needs, and environmental sustainability. By following these design principles, a more intelligent, comfortable and personalized driving experience will be created by intelligent cockpit. 2.3. The future outlook of the intelligent cockpit Application of augmented reality technology: Augmented reality technology can combine virtual information with the real world to provide drivers with a richer visual experience. In the future, the intelligent cockpit will further integrate augmented reality technology to enhance the fun and convenience of driving by combining navigation, entertainment and, and social functions with real-life scenarios. Progress in speech recognition and natural language processing technology: Speech recognition and natural language processing technology will further improve the intelligence level of intelligent cockpit. Through voice commands, the driver can control the function of the vehicle more easily and effective and reduce the adverse effect on driving by avoiding excessive distraction. At the same time, natural language processing technology will enable the intelligent cockpit to better understand the driver's intentions and provide more personalized services. Integration of multi-modal interaction: In the future, the intelligent cockpit will further integrate a variety of interaction modes, including touch, voice, gestures, eye movements, etc., to provide drivers with a more natural and convenient interactive experience. Through the integration of multi-modal interaction, the intelligent cockpit can better understand the driver's intentions and needs, and make driver more easier to offer orders to the vehicle system. Further development of emotional design: Emotional design will be further integrated into the design of the intelligent cockpit, so that the car is not only a means of transportation, but also a kind of emotional sustenance. Through intelligent perception and emotional computing and other technologies, the intelligent cockpit can sense the driver's emotions by capturing facial expression and characteristic of voice information, and provide interventions timely. In the future, the intelligent cockpit will be more intelligent, personalized, emotional and environmentally friendly. With the continuous progress and application of technology, the intelligent cockpit will provide drivers with a more comfortable, convenient, safe and environmentally friendly driving experience, and promote the sustainable development of the automotive industry. At the same time, the development of intelligent cockpit will also have a profound impact on the design, manufacturing and transportation, leading the new direction of the future automobile industry. 3. Multimodal Interaction 3.1. Definition and importance of multimodal interaction Multimodal interaction is a situation where the user is provided with multiple channels for interacting with the system or machine, including information input and order output processes. In human-vehicle interaction, multimodal interaction refers to the process that to enhance or improve the efficiency of information acquisition through multiple perceptual channels and effectiveness and comfort of operation for driver to send order to vehicle. First, multimodal interaction can improve the safety of driving. During driving, the driver needs to obtain and process information quickly in order to make accurate judgment and operation. Multimodal interaction can provide information through multiple perceptual channels, help drivers better understand and respond to changes in the driving environment, and reduce cognitive load and operational errors during driving. Secondly, multimodal interaction can improve the pleasure and comfort of driving. By integrating information from multiple perceptual channels, multimodal interactions can provide drivers with a richer and more personalized driving experience. For example, the driver can control the operation of navigation and music through voice commands, and can also get more personalized feedback and prompts through tactile sensing of the vibration and temperature changes of the seat. Finally, the multi-modal interaction is one of the key technologies to realize the intelligent cockpit. Intelligent cockpit requires providing intelligent, personalized and emotional services to meet the diversified needs of users. Multi-modal interaction can provide users with intelligent analysis and processing of their behaviors and needs, provide more intimate and convenient services, and improve their satisfaction and loyalty. In short, multi-modal interaction is of great significance in human-vehicle interaction, which can improve the safety, comfort and fun of driving, and can also promote the development and application of intelligent cockpit. With the continuous progress and application of technology, multimodal interaction will become one of the important development directions of human-vehicle interaction in the future. 3.2. Common forms of a multimodal interaction Multimodal interaction is a broad term that encompasses a 176 range of interaction methods that utilize multiple sensory channels. In the context of automobiles, these channels might include visual, auditory, tactile, and even olfactory feedback. The specific forms that multimodal interaction takes in automobiles are constantly evolving, but several common forms have emerged. One of the most basic forms of multimodal interaction in automobiles is the integration of visual and auditory feedback. For example, many modern cars now feature heads-up displays that project crucial information like speed and navigation directions onto the windshield. This allows drivers to keep their eyes on the road while still accessing important information. Similarly, auditory feedback is often used to notify drivers of things like low tire pressure, incoming phone calls, or turn signals engaging. Tactile feedback, or haptic feedback, is another important form of multimodal interaction in automobiles. This often manifests in the form of seat vibrations that notify the driver of things like lane changes or incoming obstacles detected by the car's sensors. Haptic feedback can also be used to provide more nuanced feedback, such as Simulate engine RPM changes or pavement conditions. Voice control is another rapidly developing form of multimodal interaction in automobiles. By simply speaking a command, drivers can control features like the radio, climate control, or even navigate to a specific destination. This not only improves driver safety by keeping hands free but also offers a more natural and intuitive way to interact with the car's infotainment system. The future of multimodal interaction in automobiles looks even more diverse and inclusive. As technology continues to advance, we can expect to see more advanced forms of feedback, including personalized scents or even brain- computer interfaces that allow drivers to control car features with their thoughts. The key will be to strike a balance between providing useful information without overloading the driver or disrupting their focus on the road ahead. 3.3. Challenges and solutions of multimodal interaction Multimodal interaction in the context of automobiles presents unique challenges that must be addressed to ensure safe and excellent user experience. Here are some of the key challenges and potential solutions for implementing multimodal interaction in intelligent cockpit: Integration Complexity: Integrating multiple modes of interaction into a single system can be complex and time- consuming. To address this, development teams can leverage pre-existing frameworks and APIs that simplify the process of integrating various inputs and outputs. Synchronization of Modalities: Ensuring that the different modes of interaction work together seamlessly is crucial. For example, auditory feedback should complement visual information, rather than compete with it. Development teams should invest in rigorous testing to ensure that the different modalities enhance each other, rather than detract from the overall user experience. User Acceptance: Introducing new forms of interaction can require users to adapt and learn new behaviors. Conducting user studies and iterative testing can help identify design considerations that encourage user acceptance and familiarity with the new interfaces. Data Privacy and Security: Collecting and processing data from multiple sources raises privacy and security concerns. It is essential to ensure that any personal data collected is used solely for the intended purpose, with robust encryption and access controls implemented to prevent unauthorized access. Fail-Safe Design: In the event of a technical failure, it is crucial that the system can revert to a safe and functional state. Designers should consider implementing redundancy and fallback mechanisms that can take over in case of a malfunction or system failure. Standardization and Interoperability: As the automotive industry continues to evolve, standardization efforts are essential to ensure that different systems can work together seamlessly. Development teams should be mindful of open standards and strive to design components that are compatible with evolving industry standards. Testing and Validation: Ensuring the reliability and safety of multimodal interaction systems is paramount. Development teams should conduct rigorous testing under various conditions, including real-world driving scenarios, to identify potential issues and address them proactively. To address these challenges, development teams must take a comprehensive approach to creating robust and user- friendly multimodal interaction systems. By investing in research and development, they can identify the most effective ways to integrate multiple interaction modes, such as voice control, gesture control, and touchscreen interfaces. By conducting rigorous testing under various conditions, they can identify potential issues and address them proactively. In addition to technological advancements, it is important to consider the human factors involved in multimodal interaction. User acceptance is crucial, and design teams should strive to create interfaces that are intuitive and easy to use. They should also consider the importance of feedback and response times, as these factors can significantly impact the user experience. Furthermore, development teams must work closely with domain experts, such as ergonomists and usability experts, to ensure that the systems they create are both safe and functional. This includes considering factors such as driver distraction and cognitive, which can have a significant impact on driving safety. By taking a holistic approach that combines technological innovation with human factors consideration, development teams can create multimodal interaction systems that truly enhance the driving experience while ensuring safety and reliability. This will not only improve user satisfaction but also contribute to road safety and ultimately the evolution of the automotive industry. 4. Conclusion With the rapid development of science and technology, the human-vehicle interaction and user experience have become an important part of the automobile industry innovation. In recent years, remarkable progress in this field has provided new ideas and directions for future vehicle design. First, in terms of human-vehicle interaction, the research focuses on more natural ways of interaction. While traditional car interaction relies mainly on physical buttons and knobs, modern research focus on speech recognition, gesture control, and eye tracking that more natural. These technologies not only simplify the operation of the driving process, but also greatly improve the safety of driving. Secondly, the research of user experience is also deepening. This includes the user's feelings and evaluation of the interior environment, information design, and the driver assistance 177 system. Through qualitative and quantitative research methods, designers can deeply understand the real needs of users, so as to design a more humanized automotive interior decoration and functions. In addition, the combination of emotional computing and artificial intelligence has brought entirely new possibilities for human-vehicle interaction. By identifying and analyzing the driver's emotional state, the vehicle can provide more personalized services, such as automatic music adjustment, temperature adjustment, etc., to further improve driving comfort and safety. However, despite some achievements, there are still many challenges. For example, how to ensure the reliability and accuracy of speech recognition, gesture control and other technologies in various environmental conditions? How to balance the safety and convenience during driving? These are all important directions for future research. To sum up, the frontier research of human-vehicle interaction issues is constantly promoting the innovation and development of the automobile industry. With the progress of technology and the deepening of research, the future car will be more intelligent, convenient and humanized, providing unprecedented experience for drivers. References [1] Smith, A. & Johnson, B. (2023). The future of automotive user interfaces: Multimodal interaction for safer, smarter driving. Journal of Human-Computer Interaction, 15(2), 1-21. [2] Lee, J. & Kim, J. (2023). Emotion recognition in the car: Bridging the gap between human and machine. IEEE Transactions on Affective Computing, 14(1), 1-11. [3] Zhang, Y., Wang, L. & Wu, J. (2023). User-centered design in automotive human-machine interfaces: A review and future directions. International Journal of Automotive Technology and Management, 23(3), 295-316. [4] Li, H., Liu, M. & Chen, X. (2023). The impact of multimodal interfaces on driver distraction and cognitive workload: A field study. Ergonomics, 66(4), 301-316. [5] Wang, G., Wu, J. & Xu, Y. (2023). Voice control in the car: State of the art and future challenges. Speech Communication, 145, 103782. [6] Elhage, S., Khamis, A., Elsherbiny, S., Shalaby, W., Nasereddin, W. & Mahmoud, M. (2023). Gesture recognition for automotive applications: A survey and future directions. Sensors, 23(5), 1-28. [7] Chowdhury, S., Chatterjee, S., Ong, S., Karim, N., Matthews, R. & Eversmann, B. (2023). Enhancing driving safety through intelligent driver monitoring systems: State of the art and future challenges. IEEE Intelligent Transportation Systems Magazine, 15(4), 4-19. [8] Liu, Y., Liang, Z., Chen, Z., Wang, H. & Chen, Y. (2023). Eye tracking in the car: State of the art and future directions. Ergonomics, 66(8), 595-614. [9] Al-Jarrah, A., Al-Zoubi, A., Al-Shawi, F., Al-Shawabkeh, M., Ghazal, H., Matthews, R., ... & Nasereddin, W. (2023). Automotive human-machine interfaces: Challenges and opportunities in a connected and automated driving era. Automation in Construction, 144, 104757. [10] Gupta, P., Saha, S., Bhattacharyya, R., Bandyopadhyay, D., Sinha, R. & Samantaray, A. (2023). The role of affective computing in enhancing automotive user experience: State of the art and future challenges. Journal of Affective Computing, 14(4), 1-19.