In this research, we study the relationship between mental workload and facial temperature of aircraft participants during a simulated takeoff flight. We conducted experiments to comprehend the correlation between wor...In this research, we study the relationship between mental workload and facial temperature of aircraft participants during a simulated takeoff flight. We conducted experiments to comprehend the correlation between work and facial temperature within the flight simulator. The experiment involved a group of 10 participants who played the role of pilots in a simulated A-320 flight. Six different flying scenarios were designed to simulate normal and emergency situations on airplane takeoff that would occur in different levels of mental workload for the participants. The measurements were workload assessment, face temperatures, and heart rate monitoring. Throughout the experiments, we collected a total of 120 instances of takeoffs, together with over 10 hours of time-series data including heart rate, workload, and face thermal images and temperatures. Comparative analysis of EEG data and thermal image types, revealed intriguing findings. The results indicate a notable inverse relationship between workload and facial muscle temperatures, as well as facial landmark points. The results of this study contribute to a deeper understanding of the physiological effects of workload, as well as practical implications for aviation safety and performance.展开更多
Mental workload is considered to be strongly linked to human performance,and the ability to measure it accurately is key for balancing human health and work.In this study,brain signals were elicited by mental arithmet...Mental workload is considered to be strongly linked to human performance,and the ability to measure it accurately is key for balancing human health and work.In this study,brain signals were elicited by mental arithmetic tasks of varying difficulty to stimulate different levels of mental workload.In addition,a finite impulse response(FIR)filter,independent component analysis(ICA),and multiple artifact rejection algorithms(MARAs)were used to filter event-related potentials(ERPs).Then,the data consisting of ERPs,subjective ratings of mental workload,and task performance,were analyzed through the use of variance and Spearman’s correlation during a simulated computer task.We found that participants responded faster and performed better in the easy task condition,followed by the medium and high-difficulty conditions,which verifies the validity of the ERP filtering.Moreover,larger P2 and P3 waveforms were evoked as the task difficulty increased,and a higher task difficulty elicited a more enhanced N300.Correlation analysis revealed a negative relationship between the amplitude of P3 and the subjective ratings,and a positive relationship between the P3 amplitude and accuracy.The results presented in this paper demonstrate that a combination of FIR,ICA,and MARA methods can filter ERPs in the non-invasive real-time measurement of workload.Additionally,frontocentral P2,N3,and parietal P3 components showed differences between genders.The proposed measurement of mental workload can be useful for real-time identification of mental states and can be applied to human-computer interaction in the future.展开更多
Physiological measures indexed by fixation frequency and total fixation time,task performance based on n-back accuracy,subjective assessment based on NASA Task Load Index(NASA-TLX) were used to measure the Mental Work...Physiological measures indexed by fixation frequency and total fixation time,task performance based on n-back accuracy,subjective assessment based on NASA Task Load Index(NASA-TLX) were used to measure the Mental Workload(MW) in different levels which were induced by vision-related flight task combined with auditory cognitive load. 16 healthy novice pilots were recruited to complete a monitoring task based on Head-Up Display(HUD) and an auditory n-back task which was used to manipulate the Mental Workload Level(MWL) in flight simulation environment. In our experiment,fixation frequency,average saccade time,blink rate and average pupil diameter were sensitive to MW. What's more,a comprehensive assessment method of pilot mental workload based on various measures was advocated. At last,a Fisher projection function based on the Fisher discrimination method and a three-level discriminate model established by the Bayes discrimination method were built up,the original validation and cross-validation methods of both models were 97. 92% and 95. 83% respectively,which could discriminate various Mental Workload Levels(MWLs) ideally.展开更多
Objectives: To evaluate the perceived mental workload and to identify its individual and professional determinants among Tunisian caregivers in university hospitals. Methods: A cross-sectional study was carried out in...Objectives: To evaluate the perceived mental workload and to identify its individual and professional determinants among Tunisian caregivers in university hospitals. Methods: A cross-sectional study was carried out in two university hospitals of the center of Tunisia, which employ 1179 paramedics providing care activities. The survey was conducted within a representative sample, of 301 caregivers assigned to 28 medical and surgical services, randomly drawn, after being paired according to age, gender and work schedule. It included structured inquiry (socio-professional characteristics, occupational perceived workload) and validated questionnaires (Job Content Questionnaire of Karasek, SF12, WAI). Results: Mental workload was perceived as “moderate” by 145 caregivers (48.49%) and as “heavy” by 119 caregivers (40.61% of them). Among the sample, 209 paramedics endured at least once the fixed night work schedules along their respective careers, with an average of 5.63 ± 7.54 years. According to the WAI index, 39.59% of subjects considered their capacity of work as low. Moreover, job strain was noted in 19.79%. Indeed, work latitude was unsatisfactory among 41% of caregiver, 60.1% of them mentioned the absence of colleagues’ support. A feeling of job insecurity was reported by 73.72% of subjects. Multi-varied analytic study concluded that heavier perceived mental work load was correlated to individual determinants particularly age >45 years (p -3), overweight or obesity (p = 0.02), more than three depending children (p -3), lower degree obtained (p -3), working grade as nurse assistant (P = 0.001), lower quality of physical life (0.010) and expressed willingness to retire early (p = 0.003). Conclusion: The heavy perception of mental workload associated to care activities, is one of the reasons of premature departure among nurses from professional activity. Preventive actions on professional determinants of perceived workload can reduce this phenomenon.展开更多
The digital simulation technology is adopted to establish the flight environment and scenario,which realizes the flight display instrument interface and unusual attitude recovery task.The humancomputer interaction(HCI...The digital simulation technology is adopted to establish the flight environment and scenario,which realizes the flight display instrument interface and unusual attitude recovery task.The humancomputer interaction(HCI) experiment is carried out in the flight simulation system,and the behavior performances and physiological parameters are recorded as the evaluation indices of mental workload.Participants are required to perform the unusual attitude recovery tasks and keep monitoring the target flight indicators.Once the unusual attitude occurs,the corresponding operation of steering wheel is expected to be taken immediately to response and eliminate it.The results show that most of behavior performances and physiological parameters are sensitive to mental workload and some of the indices are significantly correlative.展开更多
With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out ...With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out under flight simulation task conditions using the performance evaluation, subjective evaluation and physiological measurement methods. The experimental results show that with an increased mental workload, the detection accuracy of flight operation significantly reduced and the reaction time was significantly prolonged; the standard deviation of R-R intervals（SDNN） significantly decreased, while the mean heart rate exhibited little change; the score of NASA_TLX scale significantly increased. On this basis, the indexes sensitive to mental workload were screened, and an integrated model for the discrimination and prediction of mental workload of aircraft cockpit display interface was established based on the Bayesian Fisher discrimination and classification method. The original validation and cross-validation methods were employed to test the accuracy of the results of discrimination and prediction of the integrated model, and the average prediction accuracies determined by these two methods are both higher than 85%. Meanwhile, the integrated model shows a higher accuracy in discrimination and prediction of mental workload compared with single indexes. The model proposed in this paper exhibits a satisfactory coincidence with the measured data and could accurately reflect the variation characteristics of the mental workload of aircraft cockpit display interface, thus providing a basis for the ergonomic evaluation and optimization design of the aircraft cockpit display interface in the future.展开更多
Mental fatigue is a complex state that results from prolonged cognitive activity. Symptoms of mental fatigue can include change in mood, motivation, and temporary deterioration of various cognitive functions involved ...Mental fatigue is a complex state that results from prolonged cognitive activity. Symptoms of mental fatigue can include change in mood, motivation, and temporary deterioration of various cognitive functions involved in goal-directed behavior. Extensive research has been done to develop methods for recognizing physiological and psychophysiological signs of mental fatigue. This has allowed the development of many AI-based models to classify different levels of fatigue, using data extracted from eye-tracking device, EEG, or ECG. In this paper, we present an experimental protocol which aims to both generate/measure mental fatigue and provide effective strategies for recuperation via VR sessions paired with EEG and eye tracking devices. This paper first provides a comprehensive state-of-the-art of mental fatigue predictive factors, measurement methods, and recuperation strategies. Then the paper presents an experimental protocol resulting from the state-of-the-art to 1) generate and measure mental fatigue and 2) evaluate the effectiveness of virtual therapy for fatigue recuperation, using a virtual reality (VR) simulated environment. In our work, we successfully generated mental fatigue through completion of cognitive tasks in a virtual simulated environment. Participants showed significant decline in pupil diameter and theta/alpha score during the various cognitive tasks. We trained an RBF SVM classifier from Electroencephalogram (EEG) data classifying mental fatigue with 95% accuracy on the test set. Finally, our results show that the time allocated for virtual therapy did not improve pupil diameter in post-relaxation period. Further research on the impact of relaxation therapy on relaxation therapy should allocate time closer to the standard recovery time of 60 min.展开更多
Purpose–The presentation of in-vehicle warnings information at risky driving scenarios is aimed to improve the collision avoidance ability of drivers.Existing studies have found that driver’s collision avoidance per...Purpose–The presentation of in-vehicle warnings information at risky driving scenarios is aimed to improve the collision avoidance ability of drivers.Existing studies have found that driver’s collision avoidance performance is affected by both warning information and driver’s workload.However,whether moderation and mediation effects exist among warning information,driver’s cognition,behavior and risky avoidance performance is unclear.Design/methodology/approach–This purpose of this study is to examine whether the warning information type modifies the relationship between the forward collision risk and collision avoidance behavior.A driving simulator experiment was conducted with waring and command information.Findings–Results of 30 participants indicated that command information improves collision avoidance behavior more than notification warning under the forward collision risky driving scenario.The primary reason for this is that collision avoidance behavior can be negatively affected by the forward collision risk.At the same time,command information can weaken this negative effect.Moreover,improved collision avoidance behavior can be achieved through increasing drivers’mental workload.Practical implications–The proposed model provides a comprehensive understanding of the factors influencing collision avoidance behavior,thus contributing to improved in-vehicle information system design.Originality/value–The significant moderation effects evoke the fact that information types and mental workloads are critical in improving drivers’collision avoidance ability.Through further calibration with larger sample size,the proposed structural model can be used to predict the effect of invehicle warnings in different risky driving scenarios.展开更多
脑力负荷识别对提高人机交互操作人员的工作绩效具有重要意义。目前已有研究表明,通过提取脑电(electroencephalogram,EEG)信号的能量特征进行脑力负荷识别取得了不错的分类效果。但该方法只关注到信号的幅度信息,而忽略了相位信息;只...脑力负荷识别对提高人机交互操作人员的工作绩效具有重要意义。目前已有研究表明,通过提取脑电(electroencephalogram,EEG)信号的能量特征进行脑力负荷识别取得了不错的分类效果。但该方法只关注到信号的幅度信息,而忽略了相位信息;只分析了各个通道的频域特征,没有考虑不同通道信号之间的同步关系。为充分考虑不同脑区间的功能连接性,提出一种基于加权相位滞后指数(weighted phase lag index,WPLI)热力图的脑力负荷分类方法。对预处理后的脑电信号计算两两通道间的WPLI并绘制热力图,用于评估不同通道信号之间的相位耦合情况,由此反映不同脑区间的功能连接性。由WPLI热力图可以直观地观察到:在高、低负荷状态下,大脑功能连接性的分布存在明显差异。通过实验分别对能量特征图和WPLI热力图采用方向梯度直方图-支持向量机(histogram of oriented gradient-support vector machine,HOG-SVM)和LeNet-5两种方法进行分类。结果表明:WPLI热力图和LeNet-5的组合具有较好的分类结果。展开更多
文摘In this research, we study the relationship between mental workload and facial temperature of aircraft participants during a simulated takeoff flight. We conducted experiments to comprehend the correlation between work and facial temperature within the flight simulator. The experiment involved a group of 10 participants who played the role of pilots in a simulated A-320 flight. Six different flying scenarios were designed to simulate normal and emergency situations on airplane takeoff that would occur in different levels of mental workload for the participants. The measurements were workload assessment, face temperatures, and heart rate monitoring. Throughout the experiments, we collected a total of 120 instances of takeoffs, together with over 10 hours of time-series data including heart rate, workload, and face thermal images and temperatures. Comparative analysis of EEG data and thermal image types, revealed intriguing findings. The results indicate a notable inverse relationship between workload and facial muscle temperatures, as well as facial landmark points. The results of this study contribute to a deeper understanding of the physiological effects of workload, as well as practical implications for aviation safety and performance.
基金supported by the National Natural Science Foundation of China(Nos.71801002,71701003)the Humanities and Social Science Fund of the Ministry of Education of China(No.18YJC630023)+1 种基金the Natural Science Foundation of Anhui Province(No.1808085QG228)the Postdoctoral Program of Liaoning Province.
文摘Mental workload is considered to be strongly linked to human performance,and the ability to measure it accurately is key for balancing human health and work.In this study,brain signals were elicited by mental arithmetic tasks of varying difficulty to stimulate different levels of mental workload.In addition,a finite impulse response(FIR)filter,independent component analysis(ICA),and multiple artifact rejection algorithms(MARAs)were used to filter event-related potentials(ERPs).Then,the data consisting of ERPs,subjective ratings of mental workload,and task performance,were analyzed through the use of variance and Spearman’s correlation during a simulated computer task.We found that participants responded faster and performed better in the easy task condition,followed by the medium and high-difficulty conditions,which verifies the validity of the ERP filtering.Moreover,larger P2 and P3 waveforms were evoked as the task difficulty increased,and a higher task difficulty elicited a more enhanced N300.Correlation analysis revealed a negative relationship between the amplitude of P3 and the subjective ratings,and a positive relationship between the P3 amplitude and accuracy.The results presented in this paper demonstrate that a combination of FIR,ICA,and MARA methods can filter ERPs in the non-invasive real-time measurement of workload.Additionally,frontocentral P2,N3,and parietal P3 components showed differences between genders.The proposed measurement of mental workload can be useful for real-time identification of mental states and can be applied to human-computer interaction in the future.
基金Sponsored by the Tianjin Key Laboratory of Civil Aircraft Airworthiness and Maintenance in CAUC(Grant No.M J-J-2012-07)
文摘Physiological measures indexed by fixation frequency and total fixation time,task performance based on n-back accuracy,subjective assessment based on NASA Task Load Index(NASA-TLX) were used to measure the Mental Workload(MW) in different levels which were induced by vision-related flight task combined with auditory cognitive load. 16 healthy novice pilots were recruited to complete a monitoring task based on Head-Up Display(HUD) and an auditory n-back task which was used to manipulate the Mental Workload Level(MWL) in flight simulation environment. In our experiment,fixation frequency,average saccade time,blink rate and average pupil diameter were sensitive to MW. What's more,a comprehensive assessment method of pilot mental workload based on various measures was advocated. At last,a Fisher projection function based on the Fisher discrimination method and a three-level discriminate model established by the Bayes discrimination method were built up,the original validation and cross-validation methods of both models were 97. 92% and 95. 83% respectively,which could discriminate various Mental Workload Levels(MWLs) ideally.
文摘Objectives: To evaluate the perceived mental workload and to identify its individual and professional determinants among Tunisian caregivers in university hospitals. Methods: A cross-sectional study was carried out in two university hospitals of the center of Tunisia, which employ 1179 paramedics providing care activities. The survey was conducted within a representative sample, of 301 caregivers assigned to 28 medical and surgical services, randomly drawn, after being paired according to age, gender and work schedule. It included structured inquiry (socio-professional characteristics, occupational perceived workload) and validated questionnaires (Job Content Questionnaire of Karasek, SF12, WAI). Results: Mental workload was perceived as “moderate” by 145 caregivers (48.49%) and as “heavy” by 119 caregivers (40.61% of them). Among the sample, 209 paramedics endured at least once the fixed night work schedules along their respective careers, with an average of 5.63 ± 7.54 years. According to the WAI index, 39.59% of subjects considered their capacity of work as low. Moreover, job strain was noted in 19.79%. Indeed, work latitude was unsatisfactory among 41% of caregiver, 60.1% of them mentioned the absence of colleagues’ support. A feeling of job insecurity was reported by 73.72% of subjects. Multi-varied analytic study concluded that heavier perceived mental work load was correlated to individual determinants particularly age >45 years (p -3), overweight or obesity (p = 0.02), more than three depending children (p -3), lower degree obtained (p -3), working grade as nurse assistant (P = 0.001), lower quality of physical life (0.010) and expressed willingness to retire early (p = 0.003). Conclusion: The heavy perception of mental workload associated to care activities, is one of the reasons of premature departure among nurses from professional activity. Preventive actions on professional determinants of perceived workload can reduce this phenomenon.
基金National Basic Research Program of China(No.2010CB734104)Foundation of Graduate Technology Innovation and Practice of Beihang University,China(No.YCSJ-01-201305)
文摘The digital simulation technology is adopted to establish the flight environment and scenario,which realizes the flight display instrument interface and unusual attitude recovery task.The humancomputer interaction(HCI) experiment is carried out in the flight simulation system,and the behavior performances and physiological parameters are recorded as the evaluation indices of mental workload.Participants are required to perform the unusual attitude recovery tasks and keep monitoring the target flight indicators.Once the unusual attitude occurs,the corresponding operation of steering wheel is expected to be taken immediately to response and eliminate it.The results show that most of behavior performances and physiological parameters are sensitive to mental workload and some of the indices are significantly correlative.
基金supported by the National Basic Research Program of China (No. 2010CB734104)
文摘With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out under flight simulation task conditions using the performance evaluation, subjective evaluation and physiological measurement methods. The experimental results show that with an increased mental workload, the detection accuracy of flight operation significantly reduced and the reaction time was significantly prolonged; the standard deviation of R-R intervals（SDNN） significantly decreased, while the mean heart rate exhibited little change; the score of NASA_TLX scale significantly increased. On this basis, the indexes sensitive to mental workload were screened, and an integrated model for the discrimination and prediction of mental workload of aircraft cockpit display interface was established based on the Bayesian Fisher discrimination and classification method. The original validation and cross-validation methods were employed to test the accuracy of the results of discrimination and prediction of the integrated model, and the average prediction accuracies determined by these two methods are both higher than 85%. Meanwhile, the integrated model shows a higher accuracy in discrimination and prediction of mental workload compared with single indexes. The model proposed in this paper exhibits a satisfactory coincidence with the measured data and could accurately reflect the variation characteristics of the mental workload of aircraft cockpit display interface, thus providing a basis for the ergonomic evaluation and optimization design of the aircraft cockpit display interface in the future.
文摘Mental fatigue is a complex state that results from prolonged cognitive activity. Symptoms of mental fatigue can include change in mood, motivation, and temporary deterioration of various cognitive functions involved in goal-directed behavior. Extensive research has been done to develop methods for recognizing physiological and psychophysiological signs of mental fatigue. This has allowed the development of many AI-based models to classify different levels of fatigue, using data extracted from eye-tracking device, EEG, or ECG. In this paper, we present an experimental protocol which aims to both generate/measure mental fatigue and provide effective strategies for recuperation via VR sessions paired with EEG and eye tracking devices. This paper first provides a comprehensive state-of-the-art of mental fatigue predictive factors, measurement methods, and recuperation strategies. Then the paper presents an experimental protocol resulting from the state-of-the-art to 1) generate and measure mental fatigue and 2) evaluate the effectiveness of virtual therapy for fatigue recuperation, using a virtual reality (VR) simulated environment. In our work, we successfully generated mental fatigue through completion of cognitive tasks in a virtual simulated environment. Participants showed significant decline in pupil diameter and theta/alpha score during the various cognitive tasks. We trained an RBF SVM classifier from Electroencephalogram (EEG) data classifying mental fatigue with 95% accuracy on the test set. Finally, our results show that the time allocated for virtual therapy did not improve pupil diameter in post-relaxation period. Further research on the impact of relaxation therapy on relaxation therapy should allocate time closer to the standard recovery time of 60 min.
基金sponsored by the Chinese National Science Foundation(61803283)the“Chen Guang”project supported by ShanghaiMunicipal Education Commission and Shanghai Education Development Foundation(18CG17)the Shanghai Municipal Science and Technology Major Project(No.2021SHZDZX0100)and the Fundamental Research Funds for the Central Universities.
文摘Purpose–The presentation of in-vehicle warnings information at risky driving scenarios is aimed to improve the collision avoidance ability of drivers.Existing studies have found that driver’s collision avoidance performance is affected by both warning information and driver’s workload.However,whether moderation and mediation effects exist among warning information,driver’s cognition,behavior and risky avoidance performance is unclear.Design/methodology/approach–This purpose of this study is to examine whether the warning information type modifies the relationship between the forward collision risk and collision avoidance behavior.A driving simulator experiment was conducted with waring and command information.Findings–Results of 30 participants indicated that command information improves collision avoidance behavior more than notification warning under the forward collision risky driving scenario.The primary reason for this is that collision avoidance behavior can be negatively affected by the forward collision risk.At the same time,command information can weaken this negative effect.Moreover,improved collision avoidance behavior can be achieved through increasing drivers’mental workload.Practical implications–The proposed model provides a comprehensive understanding of the factors influencing collision avoidance behavior,thus contributing to improved in-vehicle information system design.Originality/value–The significant moderation effects evoke the fact that information types and mental workloads are critical in improving drivers’collision avoidance ability.Through further calibration with larger sample size,the proposed structural model can be used to predict the effect of invehicle warnings in different risky driving scenarios.
文摘脑力负荷识别对提高人机交互操作人员的工作绩效具有重要意义。目前已有研究表明,通过提取脑电(electroencephalogram,EEG)信号的能量特征进行脑力负荷识别取得了不错的分类效果。但该方法只关注到信号的幅度信息,而忽略了相位信息;只分析了各个通道的频域特征,没有考虑不同通道信号之间的同步关系。为充分考虑不同脑区间的功能连接性,提出一种基于加权相位滞后指数(weighted phase lag index,WPLI)热力图的脑力负荷分类方法。对预处理后的脑电信号计算两两通道间的WPLI并绘制热力图,用于评估不同通道信号之间的相位耦合情况,由此反映不同脑区间的功能连接性。由WPLI热力图可以直观地观察到:在高、低负荷状态下,大脑功能连接性的分布存在明显差异。通过实验分别对能量特征图和WPLI热力图采用方向梯度直方图-支持向量机(histogram of oriented gradient-support vector machine,HOG-SVM)和LeNet-5两种方法进行分类。结果表明:WPLI热力图和LeNet-5的组合具有较好的分类结果。
基金supported by Sichuan Applied Psychology Research Center of Chengdu Medical College(Number:CSXL-23408)the Humanities and Social Science Research Planning Fund of the Ministry of Education of the People's Republic of China(22YJA630087).
