This paper explores the transformative impact of virtual worlds, augmented reality (AR), and the metaverse in the healthcare sector. It delves into the ways these technologies are reshaping patient care, medical educa...This paper explores the transformative impact of virtual worlds, augmented reality (AR), and the metaverse in the healthcare sector. It delves into the ways these technologies are reshaping patient care, medical education, and research, while also addressing the challenges and opportunities they present. The paper highlights the potential benefits of these technologies and emphasizes the need for comprehensive regulatory frameworks and ethical guidelines to ensure responsible integration. Finally it outlines their transformative impact and discusses the challenges and opportunities they present for the future of healthcare provision.展开更多
As new power systems and dual carbon policies develop,virtual power plant cluster(VPPC)provides another reliable way to promote the efficient utilization of energy and solve environmental pollution problems.To solve t...As new power systems and dual carbon policies develop,virtual power plant cluster(VPPC)provides another reliable way to promote the efficient utilization of energy and solve environmental pollution problems.To solve the coordinated optimal operation and low-carbon economic operation problem in multi-virtual power plant,a multi-virtual power plant(VPP)electricity-carbon interaction optimal scheduling model considering integrated demand response(IDR)is proposed.Firstly,a multi-VPP electricity-carbon interaction framework is established.The interaction of electric energy and carbon quotas can realize energy complementarity,reduce energy waste and promote low-carbon operation.Secondly,in order to coordinate the multiple types of energy and load in VPPC to further achieve low-carbon operation,the IDR mechanism based on the user comprehensive satisfaction(UCS)of electricity,heat as well as hydrogen is designed,which can effectively maintain the UCS in the cluster within a relatively high range.Finally,the unit output scheme is formulated to minimize the total cost of VPPC and the model is solved using theCPLEX solver.The simulation results showthat the proposed method effectively promotes the coordinated operation among multi-VPP,increases the consumption rate of renewable energy sources and the economics of VPPC and reduces carbon emissions.展开更多
The informatization of higher vocational education is the future development trend,and it is also encouraged and promoted by the Ministry of Education.This article focuses on the road and bridge major,combined with th...The informatization of higher vocational education is the future development trend,and it is also encouraged and promoted by the Ministry of Education.This article focuses on the road and bridge major,combined with the author’s experience in introducing virtual simulation and three-dimensional(3D)animation technology into relevant course teaching in recent years,discusses the application of virtual simulation and 3D animation technology in higher vocational education and promotes classroom revolution,to obtain better teaching effect.展开更多
Background Physical entity interactions in mixed reality(MR)environments aim to harness human capabilities in manipulating physical objects,thereby enhancing virtual environment(VEs)functionality.In MR,a common strate...Background Physical entity interactions in mixed reality(MR)environments aim to harness human capabilities in manipulating physical objects,thereby enhancing virtual environment(VEs)functionality.In MR,a common strategy is to use virtual agents as substitutes for physical entities,balancing interaction efficiency with environmental immersion.However,the impact of virtual agent size and form on interaction performance remains unclear.Methods Two experiments were conducted to explore how virtual agent size and form affect interaction performance,immersion,and preference in MR environments.The first experiment assessed five virtual agent sizes(25%,50%,75%,100%,and 125%of physical size).The second experiment tested four types of frames(no frame,consistent frame,half frame,and surrounding frame)across all agent sizes.Participants,utilizing a head mounted display,performed tasks involving moving cups,typing words,and using a mouse.They completed questionnaires assessing aspects such as the virtual environment effects,interaction effects,collision concerns,and preferences.Results Results from the first experiment revealed that agents matching physical object size produced the best overall performance.The second experiment demonstrated that consistent framing notably enhances interaction accuracy and speed but reduces immersion.To balance efficiency and immersion,frameless agents matching physical object sizes were deemed optimal.Conclusions Virtual agents matching physical entity sizes enhance user experience and interaction performance.Conversely,familiar frames from 2D interfaces detrimentally affect interaction and immersion in virtual spaces.This study provides valuable insights for the future development of MR systems.展开更多
We focus on the goal of undergraduate talent training,consider the course features of Road Engineering Construction Technology and Organization,analyze the problems existing in the practical teaching of the course,use...We focus on the goal of undergraduate talent training,consider the course features of Road Engineering Construction Technology and Organization,analyze the problems existing in the practical teaching of the course,use the advantages of BIM+virtual simulation technology,design a scientific and reasonable practical teaching content of Road Engineering Construction Technology and Organization,and address the contrast between the strong practical aspect of the traditional Road Engineering Construction Technology and Organization course and the lack of practical instruments in hope to improve students’learning autonomy,enhance the quality of practical teaching,achieve the training objectives of the course,and nurture applied technical talents.展开更多
Background Virtual reality technology has been widely used in surgical simulators,providing new opportunities for assessing and training surgical skills.Machine learning algorithms are commonly used to analyze and eva...Background Virtual reality technology has been widely used in surgical simulators,providing new opportunities for assessing and training surgical skills.Machine learning algorithms are commonly used to analyze and evaluate the performance of participants.However,their interpretability limits the personalization of the training for individual participants.Methods Seventy-nine participants were recruited and divided into three groups based on their skill level in intracranial tumor resection.Data on the use of surgical tools were collected using a surgical simulator.Feature selection was performed using the Minimum Redundancy Maximum Relevance and SVM-RFE algorithms to obtain the final metrics for training the machine learning model.Five machine learning algorithms were trained to predict the skill level,and the support vector machine performed the best,with an accuracy of 92.41%and Area Under Curve value of 0.98253.The machine learning model was interpreted using Shapley values to identify the important factors contributing to the skill level of each participant.Results This study demonstrates the effectiveness of machine learning in differentiating the evaluation and training of virtual reality neurosurgical performances.The use of Shapley values enables targeted training by identifying deficiencies in individual skills.Conclusions This study provides insights into the use of machine learning for personalized training in virtual reality neurosurgery.The interpretability of the machine learning models enables the development of individualized training programs.In addition,this study highlighted the potential of explanatory models in training external skills.展开更多
Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based ...Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based on virtual reality and gesture interaction.Methods The parameters of the models were obtained through actual investigation,whereby Blender and 3DS MAX were used to model and import these parameters into a physics engine.By establishing an interface for the physics engine,gesture interaction hardware,and virtual reality(VR)helmet,a highly realistic chemical experiment environment was created.Using code script logic,particle systems,as well as other systems,chemical phenomena were simulated.Furthermore,we created an online teaching platform using streaming media and databases to address the problems of distance teaching.Results The proposed system was evaluated against two mainstream products in the market.In the experiments,the proposed system outperformed the other products in terms of fidelity and practicality.Conclusions The proposed system which offers realistic simulations and practicability,can help improve the high school chemistry experimental education.展开更多
In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and...In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and cameras,often caused by environmental factors.This issue has spurred the need for advanced data processing methods to achieve more accurate gesture recognition and predictions.Our study presents a novel virtual keyboard allowing character input via distinct hand gestures,focusing on two key aspects:hand gesture recognition and character input mechanisms.We developed a novel model with LSTM and fully connected layers for enhanced sequential data processing and hand gesture recognition.We also integrated CNN,max-pooling,and dropout layers for improved spatial feature extraction.This model architecture processes both temporal and spatial aspects of hand gestures,using LSTM to extract complex patterns from frame sequences for a comprehensive understanding of input data.Our unique dataset,essential for training the model,includes 1,662 landmarks from dynamic hand gestures,33 postures,and 468 face landmarks,all captured in real-time using advanced pose estimation.The model demonstrated high accuracy,achieving 98.52%in hand gesture recognition and over 97%in character input across different scenarios.Its excellent performance in real-time testing underlines its practicality and effectiveness,marking a significant advancement in enhancing human-device interactions in the digital age.展开更多
After analyzing and comparing the traditional automobile instrument,the onboard instrument based on virtual instrument technology is designed in this paper.The PC/104 computer was employed as the core processing unit ...After analyzing and comparing the traditional automobile instrument,the onboard instrument based on virtual instrument technology is designed in this paper.The PC/104 computer was employed as the core processing unit of the onbaard in- strument,and the several intelligent data acquisition nodes are set and connected by the CAN bus,through which the nodes can com- municate with the core processing unit.The information of the vehicle’s working condition can be displayed synthetically by adopt- ing virtual instrument technology.When the working condition goes beyond its limit,the system can emit an alarm,record and storage the abnormal condition automatically,and suggest how to deal with the abnormity urgently.The development background and design idea of onboard information system were elaborated in the paper.The software,the hardware architecture and the principle of onboard information system were introduced in detail.展开更多
Objective: To explore the effects of the somatosensory interaction technology combined with virtual reality technology on upper limbs function and activities of daily living (ADL) in cerebrovascular disease patients. ...Objective: To explore the effects of the somatosensory interaction technology combined with virtual reality technology on upper limbs function and activities of daily living (ADL) in cerebrovascular disease patients. Methods: Form January, 2019 to December, 2019, 80 cerebrovascular disease patients were recruited, and had been divided into control group (n = 40) and observation group (n = 40), randomly. The control groups received conventional rehabilitation treatment, for 40 minutes per day, while observation group received conventional rehabilitation treatment, for 20 minutes per day, and virtual reality technology treatment, 20 minutes per day, 5 days a week for 4 weeks. Wolf Motor Function Test (WMFT), Fugl-Meyer Assessment-Upper Extremities (FMA-UE) and modified Barthel index (MBI) were used to assess the motor function of the upper limbs and ADL before and after treatment. Results: Before treatment, the scores of WMFT, FMA-UE and MBI were no significant difference between two groups (P > 0.05). The scores improved in both groups after treatment (P < 0.01), and were higher in the observation group than in the control group (P < 0.05). Conclusion: The somatosensory interaction technology combined with virtual reality technology could facilitate to improve the upper limbs function and ADL in cerebrovascular disease patients.展开更多
In the construction of Metaverses,sensors that are referred to as the“bridge of information transmission”,play a key role.The functionality and efficiency of today’s sensors,which operate in a manner similar to phy...In the construction of Metaverses,sensors that are referred to as the“bridge of information transmission”,play a key role.The functionality and efficiency of today’s sensors,which operate in a manner similar to physical sensing,are frequently constrained by their hardware and software.In this research,we proposed the Parallel Sensing framework,which includes background,concept,basic methods and typical application of parallel sensing.In our formulation,sensors are redefined as the integration of real physical sensors and virtual software-defined sensors based on parallel intelligence,in order to boost the performance of the sensors.Each sensor will have a parallel counterpart in the virtual world within the framework of parallel sensing.Digital sensors serve as the brain of sensors and maintain the same properties as physical sensors.Parallel sensing allows physical sensors to operate in discrete time periods to conserve energy,while cloud-based descriptive,predictive,and prescriptive sensors operate continuously to offer compensation data and serve as guardians.To better illustrate parallel sensing concept,we show some example applications of parallel sensing such as parallel vision,parallel point cloud and parallel light fields,both of which are designed by construct virtual sensors to extend small real data to virtual big data and then boost the performance of perception models.Experimental results demonstrate the effective of parallel sensing framework.The interaction between the real and virtual worlds enables sensors to operate actively,allowing them to intelligently adapt to various scenarios and ultimately attain the goal of“Cognitive,Parallel,Crypto,Federated,Social and Ecologic”6S sensing.展开更多
Based on the analysis of the security problems existing in the cloud platform of the data center, this paper proposes a set of cloud platform security protection scheme being with virtualization technology. This paper...Based on the analysis of the security problems existing in the cloud platform of the data center, this paper proposes a set of cloud platform security protection scheme being with virtualization technology. This paper focuses on the overall architecture of cloud platform as well as the design of virtualization security architecture. Meantime, it introduces the key technologies of VXLAN in detail. The scheme realizes flexible scheduling of security resources through virtual pooling of independent security gateway and virtual machine isolation through VXLAN technology. Moreover, it guides all horizontal traffic to independent security gateway for processing, unified management of security gateway through cloud platform by using Huawei NSH business chain technology. This scheme effectively solves the horizontal transmission of security threat among virtual machines, and realizes the fine security control and protection for the campus data center.展开更多
Due to the narrowness of space and the complexity of structure, the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process. To solve the problem, at the beginning of airc...Due to the narrowness of space and the complexity of structure, the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process. To solve the problem, at the beginning of aircraft design, the different stages of the lifecycle of aircraft must be thought about, which include the trial manufacture, assembly, maintenance, recycling and destruction of the product. Recently, thanks to the development of the virtual reality and augmented reality, some low-cost and fast solutions are found for the product assembly. This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly, which can enhance the efficiency of the assemblage in a virtual environment in terms of vision, information and operation. In the mixed reality-based assembly environment, the physical scene can be obtained by a camera and then generated by a computer. The virtual parts, the features of visual assembly, the navigation information, the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene. The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment. Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts, and to avoid the complex calculation of constraint's match. Finally, a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.展开更多
In a building, the paint coating applied to interior walls conveys their aesthetic character and also performs an important function of protection. It is a construction component which is exposed to agents of deterior...In a building, the paint coating applied to interior walls conveys their aesthetic character and also performs an important function of protection. It is a construction component which is exposed to agents of deterioration related to its use, needing the regular evaluation of its state of repair. The completed model supports the performance of such periodic inspections and the monitoring of interior wall maintenance, using Virtual Reality (VR) technology. Used during an inspection visit, the application allows users to consult a database of irregularities, normally associated with paint coating, classified by the most probable causes and by recommended repair methodologies. In addition, with this model, a chromatic scale related to the degree of deterioration of the coating, defined as a function of the time between the dates of the application of the paint and the scheduled repainting, can be attributed to each element of coating monitored. This use of VR technology allows inspections and the evaluation of the degree of wear and tear of materials to be carried out in a highly direct and intuitive manner. The computer application has a positive contribution to make in the field of construction, using as it does Information Technology (IT) tools which give access to innovative technology with it capacity for interaction and visualization.展开更多
With the application of virtual reality technology to realize interactive display of virtual museum as content of study,we analyze the problems in the current virtual museum system.Taking Daqing Museum for example,we ...With the application of virtual reality technology to realize interactive display of virtual museum as content of study,we analyze the problems in the current virtual museum system.Taking Daqing Museum for example,we develop a 2.5D(between 2D and 3D) architectural modeling technology,and combine it with virtual reality technology,to create the virtual museum simulation platform.By establishing the virtual simulation platform of Daqing Museum,we verify the feasibility of using 2.5D architectural modeling technology to build the virtual museum system,create a virtual simulation platform with practical value,and show the bright future of virtual museum based on 2.5D virtual reality technology.展开更多
Background Navigation assistance is essential for users when roaming virtual reality scenes;however,the traditional navigation method requires users to manually request a map for viewing,which leads to low immersion a...Background Navigation assistance is essential for users when roaming virtual reality scenes;however,the traditional navigation method requires users to manually request a map for viewing,which leads to low immersion and poor user experience.Methods To address this issue,we first collected data on who required navigation assistance in a virtual reality environment,including various eye movement features,such as gaze fixation,pupil size,and gaze angle.Subsequently,we used the boosting-based XGBoost algorithm to train a prediction model and finally used it to predict whether users require navigation assistance in a roaming task.Results After evaluating the performance of the model,the accuracy,precision,recall,and F1-score of our model reached approximately 95%.In addition,by applying the model to a virtual reality scene,an adaptive navigation assistance system based on the real-time eye movement data of the user was implemented.Conclusions Compared with traditional navigation assistance methods,our new adaptive navigation assistance method could enable the user to be more immersive and effective while roaming in a virtual reality(VR)environment.展开更多
Based on the definition of technology innovation of agricultural leading enterprises by domestic and foreign experts and scholars,technology innovation of agricultural enterprises is a process of new market increment,...Based on the definition of technology innovation of agricultural leading enterprises by domestic and foreign experts and scholars,technology innovation of agricultural enterprises is a process of new market increment,which uses new knowledge,technology,process and production mode,produces new products,offers new services and realizes commercialization. Characteristics of agricultural technology innovation are introduced,such as obvious regionality,relatively high risk,long-term periodicity and public attribute. Predicament for technology innovation of leading enterprises is analyzed,such as technical constraints,financial constraints and personnel constraints. Technological Innovation Mode can be classified into three modes of independent innovation,imitative innovation and cooperative innovation by the method of technology innovation. Among them,since there are some defects in the technology innovation process,independent innovation and imitative innovation are generally not used for the innovation of agricultural enterprises. Cooperative Innovation Mode can rely on foreign aid,can realize complementary advantages and achievement sharing,and can be widely applied in the agricultural innovation enterprise. Virtual organization in cooperation innovation mode is described,which makes up for technology,capital and human resources barriers in the process of agricultural enterprise innovation. Therefore,this mode is popular among the agricultural innovation enterprise.展开更多
As a new support platform of information technology for social development, virtual reality technology(VRT) has been widely used in many fields. Here, the concept and important features of VRT are summarized first. Th...As a new support platform of information technology for social development, virtual reality technology(VRT) has been widely used in many fields. Here, the concept and important features of VRT are summarized first. Then, the analysis requirement for VRT in design, display, operation and maintenance training, and state monitoring for aerospace products is elaborated. This is followed with a review of foreign and domestic policy planning of VRT, and their application in aerospace. Last, future development of VRT is discussed.展开更多
With the continuous promotion of computer technology, the application system of virtual simulation technology has been further optimized and improved, and has been widely used in various fields of social development, ...With the continuous promotion of computer technology, the application system of virtual simulation technology has been further optimized and improved, and has been widely used in various fields of social development, such as urban construction, interior design, industrial simulation and tourism teaching. China's three-dimensional animation production started relatively late, but has achieved good results with the support of related advanced technology in the process of development. Computer virtual simulation technology is an important technical support in the production of three-dimensional animation. In this paper, firstly, the related content of computer virtual simulation technology was introduced. Then, the specific application of this technology in the production of three-dimensional animation was further elaborated, so as to provide some reference for the improvement of the production effect of three-dimensional animation in the future.展开更多
the rapid development of computer technology has accelerated the progress of construction technology, and the application of virtual reality technology has become more and more common, which has caused earth-shaking c...the rapid development of computer technology has accelerated the progress of construction technology, and the application of virtual reality technology has become more and more common, which has caused earth-shaking changes in the thinking and mode of traditional architectural design. It plays an important role in optimizing the construction design scheme and improving the science and rationality of the architectural design. In order to realize the effective application of virtual technology in the future architectural design, it is necessary to intensify the research on its application and give full play to its application value and advantages. This paper discusses and analyzes the application and realization of virtual reality technology in the future architectural design, and predicts its future application prospects.展开更多
文摘This paper explores the transformative impact of virtual worlds, augmented reality (AR), and the metaverse in the healthcare sector. It delves into the ways these technologies are reshaping patient care, medical education, and research, while also addressing the challenges and opportunities they present. The paper highlights the potential benefits of these technologies and emphasizes the need for comprehensive regulatory frameworks and ethical guidelines to ensure responsible integration. Finally it outlines their transformative impact and discusses the challenges and opportunities they present for the future of healthcare provision.
基金supported by the National Natural Science Foundation of China (NSFC) (Grant No.52107107).
文摘As new power systems and dual carbon policies develop,virtual power plant cluster(VPPC)provides another reliable way to promote the efficient utilization of energy and solve environmental pollution problems.To solve the coordinated optimal operation and low-carbon economic operation problem in multi-virtual power plant,a multi-virtual power plant(VPP)electricity-carbon interaction optimal scheduling model considering integrated demand response(IDR)is proposed.Firstly,a multi-VPP electricity-carbon interaction framework is established.The interaction of electric energy and carbon quotas can realize energy complementarity,reduce energy waste and promote low-carbon operation.Secondly,in order to coordinate the multiple types of energy and load in VPPC to further achieve low-carbon operation,the IDR mechanism based on the user comprehensive satisfaction(UCS)of electricity,heat as well as hydrogen is designed,which can effectively maintain the UCS in the cluster within a relatively high range.Finally,the unit output scheme is formulated to minimize the total cost of VPPC and the model is solved using theCPLEX solver.The simulation results showthat the proposed method effectively promotes the coordinated operation among multi-VPP,increases the consumption rate of renewable energy sources and the economics of VPPC and reduces carbon emissions.
基金2021 Chongqing Energy Vocational College Science and Technology Department Teaching Reform Project"Discussion and Practice of Teaching Reform of"Bridge and Culvert Engineering Construction Technology"Based on Road and Bridge Simulation Software"(202106)。
文摘The informatization of higher vocational education is the future development trend,and it is also encouraged and promoted by the Ministry of Education.This article focuses on the road and bridge major,combined with the author’s experience in introducing virtual simulation and three-dimensional(3D)animation technology into relevant course teaching in recent years,discusses the application of virtual simulation and 3D animation technology in higher vocational education and promotes classroom revolution,to obtain better teaching effect.
基金the Strategic research and consulting project of Chinese Academy of Engineering(2023-HY-14).
文摘Background Physical entity interactions in mixed reality(MR)environments aim to harness human capabilities in manipulating physical objects,thereby enhancing virtual environment(VEs)functionality.In MR,a common strategy is to use virtual agents as substitutes for physical entities,balancing interaction efficiency with environmental immersion.However,the impact of virtual agent size and form on interaction performance remains unclear.Methods Two experiments were conducted to explore how virtual agent size and form affect interaction performance,immersion,and preference in MR environments.The first experiment assessed five virtual agent sizes(25%,50%,75%,100%,and 125%of physical size).The second experiment tested four types of frames(no frame,consistent frame,half frame,and surrounding frame)across all agent sizes.Participants,utilizing a head mounted display,performed tasks involving moving cups,typing words,and using a mouse.They completed questionnaires assessing aspects such as the virtual environment effects,interaction effects,collision concerns,and preferences.Results Results from the first experiment revealed that agents matching physical object size produced the best overall performance.The second experiment demonstrated that consistent framing notably enhances interaction accuracy and speed but reduces immersion.To balance efficiency and immersion,frameless agents matching physical object sizes were deemed optimal.Conclusions Virtual agents matching physical entity sizes enhance user experience and interaction performance.Conversely,familiar frames from 2D interfaces detrimentally affect interaction and immersion in virtual spaces.This study provides valuable insights for the future development of MR systems.
基金the Chongqing Engineering College Educational Teaching Reform Research Project“Practical Teaching Research of Road Engineering Construction Technology and Organization Course Based on BIM+Virtual Simulation Technology”(Project No.JY2021310).
文摘We focus on the goal of undergraduate talent training,consider the course features of Road Engineering Construction Technology and Organization,analyze the problems existing in the practical teaching of the course,use the advantages of BIM+virtual simulation technology,design a scientific and reasonable practical teaching content of Road Engineering Construction Technology and Organization,and address the contrast between the strong practical aspect of the traditional Road Engineering Construction Technology and Organization course and the lack of practical instruments in hope to improve students’learning autonomy,enhance the quality of practical teaching,achieve the training objectives of the course,and nurture applied technical talents.
基金Supported by the Yunnan Key Laboratory of Opto-Electronic Information Technology,Postgraduate Research Innovation Fund of Yunnan Normal University (YJSJJ22-B79)the National Natural Science Foundation of China (62062069,62062070,62005235)。
文摘Background Virtual reality technology has been widely used in surgical simulators,providing new opportunities for assessing and training surgical skills.Machine learning algorithms are commonly used to analyze and evaluate the performance of participants.However,their interpretability limits the personalization of the training for individual participants.Methods Seventy-nine participants were recruited and divided into three groups based on their skill level in intracranial tumor resection.Data on the use of surgical tools were collected using a surgical simulator.Feature selection was performed using the Minimum Redundancy Maximum Relevance and SVM-RFE algorithms to obtain the final metrics for training the machine learning model.Five machine learning algorithms were trained to predict the skill level,and the support vector machine performed the best,with an accuracy of 92.41%and Area Under Curve value of 0.98253.The machine learning model was interpreted using Shapley values to identify the important factors contributing to the skill level of each participant.Results This study demonstrates the effectiveness of machine learning in differentiating the evaluation and training of virtual reality neurosurgical performances.The use of Shapley values enables targeted training by identifying deficiencies in individual skills.Conclusions This study provides insights into the use of machine learning for personalized training in virtual reality neurosurgery.The interpretability of the machine learning models enables the development of individualized training programs.In addition,this study highlighted the potential of explanatory models in training external skills.
基金National Innovation and Entrepreneurship Program for College Students(202218213001)Science and Technology Innovation Strategy of Guangdong Province(Science and Technology Innovation Cultivation of University Students 2020329182130C000002).
文摘Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based on virtual reality and gesture interaction.Methods The parameters of the models were obtained through actual investigation,whereby Blender and 3DS MAX were used to model and import these parameters into a physics engine.By establishing an interface for the physics engine,gesture interaction hardware,and virtual reality(VR)helmet,a highly realistic chemical experiment environment was created.Using code script logic,particle systems,as well as other systems,chemical phenomena were simulated.Furthermore,we created an online teaching platform using streaming media and databases to address the problems of distance teaching.Results The proposed system was evaluated against two mainstream products in the market.In the experiments,the proposed system outperformed the other products in terms of fidelity and practicality.Conclusions The proposed system which offers realistic simulations and practicability,can help improve the high school chemistry experimental education.
文摘In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and cameras,often caused by environmental factors.This issue has spurred the need for advanced data processing methods to achieve more accurate gesture recognition and predictions.Our study presents a novel virtual keyboard allowing character input via distinct hand gestures,focusing on two key aspects:hand gesture recognition and character input mechanisms.We developed a novel model with LSTM and fully connected layers for enhanced sequential data processing and hand gesture recognition.We also integrated CNN,max-pooling,and dropout layers for improved spatial feature extraction.This model architecture processes both temporal and spatial aspects of hand gestures,using LSTM to extract complex patterns from frame sequences for a comprehensive understanding of input data.Our unique dataset,essential for training the model,includes 1,662 landmarks from dynamic hand gestures,33 postures,and 468 face landmarks,all captured in real-time using advanced pose estimation.The model demonstrated high accuracy,achieving 98.52%in hand gesture recognition and over 97%in character input across different scenarios.Its excellent performance in real-time testing underlines its practicality and effectiveness,marking a significant advancement in enhancing human-device interactions in the digital age.
文摘After analyzing and comparing the traditional automobile instrument,the onboard instrument based on virtual instrument technology is designed in this paper.The PC/104 computer was employed as the core processing unit of the onbaard in- strument,and the several intelligent data acquisition nodes are set and connected by the CAN bus,through which the nodes can com- municate with the core processing unit.The information of the vehicle’s working condition can be displayed synthetically by adopt- ing virtual instrument technology.When the working condition goes beyond its limit,the system can emit an alarm,record and storage the abnormal condition automatically,and suggest how to deal with the abnormity urgently.The development background and design idea of onboard information system were elaborated in the paper.The software,the hardware architecture and the principle of onboard information system were introduced in detail.
文摘Objective: To explore the effects of the somatosensory interaction technology combined with virtual reality technology on upper limbs function and activities of daily living (ADL) in cerebrovascular disease patients. Methods: Form January, 2019 to December, 2019, 80 cerebrovascular disease patients were recruited, and had been divided into control group (n = 40) and observation group (n = 40), randomly. The control groups received conventional rehabilitation treatment, for 40 minutes per day, while observation group received conventional rehabilitation treatment, for 20 minutes per day, and virtual reality technology treatment, 20 minutes per day, 5 days a week for 4 weeks. Wolf Motor Function Test (WMFT), Fugl-Meyer Assessment-Upper Extremities (FMA-UE) and modified Barthel index (MBI) were used to assess the motor function of the upper limbs and ADL before and after treatment. Results: Before treatment, the scores of WMFT, FMA-UE and MBI were no significant difference between two groups (P > 0.05). The scores improved in both groups after treatment (P < 0.01), and were higher in the observation group than in the control group (P < 0.05). Conclusion: The somatosensory interaction technology combined with virtual reality technology could facilitate to improve the upper limbs function and ADL in cerebrovascular disease patients.
基金supported by the National Key R&D Program of China(2018AAA0101502)the Science and Technology Project of SGCC(State Grid Corporation of China):Fundamental Theory of Human-in-the-Loop Hybrid-Augmented Intelligence for Power Grid Dispatch and Control。
文摘In the construction of Metaverses,sensors that are referred to as the“bridge of information transmission”,play a key role.The functionality and efficiency of today’s sensors,which operate in a manner similar to physical sensing,are frequently constrained by their hardware and software.In this research,we proposed the Parallel Sensing framework,which includes background,concept,basic methods and typical application of parallel sensing.In our formulation,sensors are redefined as the integration of real physical sensors and virtual software-defined sensors based on parallel intelligence,in order to boost the performance of the sensors.Each sensor will have a parallel counterpart in the virtual world within the framework of parallel sensing.Digital sensors serve as the brain of sensors and maintain the same properties as physical sensors.Parallel sensing allows physical sensors to operate in discrete time periods to conserve energy,while cloud-based descriptive,predictive,and prescriptive sensors operate continuously to offer compensation data and serve as guardians.To better illustrate parallel sensing concept,we show some example applications of parallel sensing such as parallel vision,parallel point cloud and parallel light fields,both of which are designed by construct virtual sensors to extend small real data to virtual big data and then boost the performance of perception models.Experimental results demonstrate the effective of parallel sensing framework.The interaction between the real and virtual worlds enables sensors to operate actively,allowing them to intelligently adapt to various scenarios and ultimately attain the goal of“Cognitive,Parallel,Crypto,Federated,Social and Ecologic”6S sensing.
文摘Based on the analysis of the security problems existing in the cloud platform of the data center, this paper proposes a set of cloud platform security protection scheme being with virtualization technology. This paper focuses on the overall architecture of cloud platform as well as the design of virtualization security architecture. Meantime, it introduces the key technologies of VXLAN in detail. The scheme realizes flexible scheduling of security resources through virtual pooling of independent security gateway and virtual machine isolation through VXLAN technology. Moreover, it guides all horizontal traffic to independent security gateway for processing, unified management of security gateway through cloud platform by using Huawei NSH business chain technology. This scheme effectively solves the horizontal transmission of security threat among virtual machines, and realizes the fine security control and protection for the campus data center.
基金supported by National Defence Basic Research Foundation of China (Grant No. B1420060173)National Hi-tech Research and Development Program of China (863 Program, Grant No. 2006AA04Z138)
文摘Due to the narrowness of space and the complexity of structure, the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process. To solve the problem, at the beginning of aircraft design, the different stages of the lifecycle of aircraft must be thought about, which include the trial manufacture, assembly, maintenance, recycling and destruction of the product. Recently, thanks to the development of the virtual reality and augmented reality, some low-cost and fast solutions are found for the product assembly. This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly, which can enhance the efficiency of the assemblage in a virtual environment in terms of vision, information and operation. In the mixed reality-based assembly environment, the physical scene can be obtained by a camera and then generated by a computer. The virtual parts, the features of visual assembly, the navigation information, the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene. The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment. Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts, and to avoid the complex calculation of constraint's match. Finally, a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.
文摘In a building, the paint coating applied to interior walls conveys their aesthetic character and also performs an important function of protection. It is a construction component which is exposed to agents of deterioration related to its use, needing the regular evaluation of its state of repair. The completed model supports the performance of such periodic inspections and the monitoring of interior wall maintenance, using Virtual Reality (VR) technology. Used during an inspection visit, the application allows users to consult a database of irregularities, normally associated with paint coating, classified by the most probable causes and by recommended repair methodologies. In addition, with this model, a chromatic scale related to the degree of deterioration of the coating, defined as a function of the time between the dates of the application of the paint and the scheduled repainting, can be attributed to each element of coating monitored. This use of VR technology allows inspections and the evaluation of the degree of wear and tear of materials to be carried out in a highly direct and intuitive manner. The computer application has a positive contribution to make in the field of construction, using as it does Information Technology (IT) tools which give access to innovative technology with it capacity for interaction and visualization.
文摘With the application of virtual reality technology to realize interactive display of virtual museum as content of study,we analyze the problems in the current virtual museum system.Taking Daqing Museum for example,we develop a 2.5D(between 2D and 3D) architectural modeling technology,and combine it with virtual reality technology,to create the virtual museum simulation platform.By establishing the virtual simulation platform of Daqing Museum,we verify the feasibility of using 2.5D architectural modeling technology to build the virtual museum system,create a virtual simulation platform with practical value,and show the bright future of virtual museum based on 2.5D virtual reality technology.
基金Supported by the National Natural Science Foundation of China (62172368)the Natural Science Foundation of Zhejiang Province (LR22F020003)。
文摘Background Navigation assistance is essential for users when roaming virtual reality scenes;however,the traditional navigation method requires users to manually request a map for viewing,which leads to low immersion and poor user experience.Methods To address this issue,we first collected data on who required navigation assistance in a virtual reality environment,including various eye movement features,such as gaze fixation,pupil size,and gaze angle.Subsequently,we used the boosting-based XGBoost algorithm to train a prediction model and finally used it to predict whether users require navigation assistance in a roaming task.Results After evaluating the performance of the model,the accuracy,precision,recall,and F1-score of our model reached approximately 95%.In addition,by applying the model to a virtual reality scene,an adaptive navigation assistance system based on the real-time eye movement data of the user was implemented.Conclusions Compared with traditional navigation assistance methods,our new adaptive navigation assistance method could enable the user to be more immersive and effective while roaming in a virtual reality(VR)environment.
基金Supported by the Social Science Planning Program of Beijing Municipal Commission of Education (SM201010020003)
文摘Based on the definition of technology innovation of agricultural leading enterprises by domestic and foreign experts and scholars,technology innovation of agricultural enterprises is a process of new market increment,which uses new knowledge,technology,process and production mode,produces new products,offers new services and realizes commercialization. Characteristics of agricultural technology innovation are introduced,such as obvious regionality,relatively high risk,long-term periodicity and public attribute. Predicament for technology innovation of leading enterprises is analyzed,such as technical constraints,financial constraints and personnel constraints. Technological Innovation Mode can be classified into three modes of independent innovation,imitative innovation and cooperative innovation by the method of technology innovation. Among them,since there are some defects in the technology innovation process,independent innovation and imitative innovation are generally not used for the innovation of agricultural enterprises. Cooperative Innovation Mode can rely on foreign aid,can realize complementary advantages and achievement sharing,and can be widely applied in the agricultural innovation enterprise. Virtual organization in cooperation innovation mode is described,which makes up for technology,capital and human resources barriers in the process of agricultural enterprise innovation. Therefore,this mode is popular among the agricultural innovation enterprise.
文摘As a new support platform of information technology for social development, virtual reality technology(VRT) has been widely used in many fields. Here, the concept and important features of VRT are summarized first. Then, the analysis requirement for VRT in design, display, operation and maintenance training, and state monitoring for aerospace products is elaborated. This is followed with a review of foreign and domestic policy planning of VRT, and their application in aerospace. Last, future development of VRT is discussed.
文摘With the continuous promotion of computer technology, the application system of virtual simulation technology has been further optimized and improved, and has been widely used in various fields of social development, such as urban construction, interior design, industrial simulation and tourism teaching. China's three-dimensional animation production started relatively late, but has achieved good results with the support of related advanced technology in the process of development. Computer virtual simulation technology is an important technical support in the production of three-dimensional animation. In this paper, firstly, the related content of computer virtual simulation technology was introduced. Then, the specific application of this technology in the production of three-dimensional animation was further elaborated, so as to provide some reference for the improvement of the production effect of three-dimensional animation in the future.
文摘the rapid development of computer technology has accelerated the progress of construction technology, and the application of virtual reality technology has become more and more common, which has caused earth-shaking changes in the thinking and mode of traditional architectural design. It plays an important role in optimizing the construction design scheme and improving the science and rationality of the architectural design. In order to realize the effective application of virtual technology in the future architectural design, it is necessary to intensify the research on its application and give full play to its application value and advantages. This paper discusses and analyzes the application and realization of virtual reality technology in the future architectural design, and predicts its future application prospects.
