This paper describes how virtual classrooms and out-of-classroom instruction can be used to help students in ideological and political theory courses strengthen their identities and improve the efficiency of their ass...This paper describes how virtual classrooms and out-of-classroom instruction can be used to help students in ideological and political theory courses strengthen their identities and improve the efficiency of their assignments.By using immersive media technology,the course is turned into a form of entertainment,enriched with content,and combined with methods such as digital video editing and manipulation to meet the needs of students in university ideological and political theory courses.Virtual reality technology can create realistic virtual environments created by computers,enabling students to perceive and manipulate a variety of virtual objects,interact with them,and create a sense of immersion in the virtual environment.Research has shown the potential benefits of using immersive media technologies and augmented reality in education.The potential of virtual reality in education has been increasingly emphasized and has been widely researched and applied.展开更多
In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as t...In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as the viewpoint of the panoramic sphere is inside the sphere.We compared three approaches to visualizing the earth for rendering the geographical information in a virtual reality environment.On the tasks of terrestrial and marine geographical information,we compare the visualization effects on a)a globe,b)a flat map and c)a panoramic sphere.Terrestrial geographical information tasks include the area comparison and direction determination.Marine geographical information tasks contain the visualization of sea surface temperature and sea surface currents.For terrestrial geographical information tasks,the experimental results show that the panoramic sphere outperforms the globe and the flat map,with a higher average accuracy and a shorter time.On marine geographical information task,the panoramic sphere visualization is also superior to the flat map and the globe in an immersive environment for the sea surface temperature data and the sea surface current fields.In all three visualization experiments,the panoramic sphere is most preferred by the participants,particularly for global,transcontinental and transoceanic needs.展开更多
Immersive services are the typical emerging services in current IMT-2020 network.With the development of network evolution,real-time interactive applications emerge one after another.This article provides an overview ...Immersive services are the typical emerging services in current IMT-2020 network.With the development of network evolution,real-time interactive applications emerge one after another.This article provides an overview on immersive services which focus on real-time interaction.The scenarios,framework,requirements,key technologies,and issues of interactive immersive service are presented.展开更多
More diverse data on animal ecology are now available.This“data deluge”presents challenges for both biologists and computer scientists;however,it also creates opportunities to improve analysis and answer more holist...More diverse data on animal ecology are now available.This“data deluge”presents challenges for both biologists and computer scientists;however,it also creates opportunities to improve analysis and answer more holistic research questions.We aim to increase awareness of the current opportunity for interdisciplinary research between animal ecology researchers and computer scientists.Immersive analytics(IA)is an emerging research field in which investigations are performed into how immersive technologies,such as large display walls and virtual reality and augmented reality devices,can be used to improve data analysis,outcomes,and communication.These investigations have the potential to reduce the analysis effort and widen the range of questions that can be addressed.We propose that biologists and computer scientists combine their efforts to lay the foundation for IA in animal ecology research.We discuss the potential and the challenges and outline a path toward a structured approach.We imagine that a joint effort would combine the strengths and expertise of both communities,leading to a well-defined research agenda and design space,practical guidelines,robust and reusable software frameworks,reduced analysis effort,and better comparability of results.展开更多
The developments in the area of brain research by analysing brain activity of individuals have given rise to many useful applications, such as diagnosing mental disorders more efficiently, treatment of cognitive disor...The developments in the area of brain research by analysing brain activity of individuals have given rise to many useful applications, such as diagnosing mental disorders more efficiently, treatment of cognitive disorders, and developing of brain-computer interfaces for treatment, communication and entertainment purposes. However, the development of such applications is hindered by a shortage of easy-to-use and comfortable sensors, as well as a lack of high-quality brain activity data. In the first part of this paper, a review of the status of BCI applications is presented followed by a proposal of a framework for developing an intelligent BCI headphone that takes leverages of the huge amount of data coming from playing video games to let the players experience a full immersive gaming experience.展开更多
Virtual reality gaining popularity across various fields including culture,tourism,and sport Exploring an ancient building in an exhibition hall,enjoying a 360-degree video,skating in front of a big screen in the midd...Virtual reality gaining popularity across various fields including culture,tourism,and sport Exploring an ancient building in an exhibition hall,enjoying a 360-degree video,skating in front of a big screen in the middle of summer...All of these are made possible by the advanced technology of virtual reality(VR),which constructs an artificial environment with scenes and objects that look like real,making people feel they are immersed in it.Using a VR headset,users can enjoy a variety of experiences in gaming,entertainment,socialising or other activities.展开更多
Spatially resolved transcriptomics is an emerging class of high-throughput technologies that enable biologists to systematically investigate the expression of genes along with spatial information.Upon data acquisition...Spatially resolved transcriptomics is an emerging class of high-throughput technologies that enable biologists to systematically investigate the expression of genes along with spatial information.Upon data acquisition,one major hurdle is the subsequent interpretation and visualization of the datasets acquired.To address this challenge,VR-Cardiomics is presented,which is a novel data visualization system with interactive functionalities designed to help biologists interpret spatially resolved transcriptomic datasets.By implementing the system in two separate immersive environments,fish tank virtual reality(FTVR)and head-mounted display virtual reality(HMD-VR),biologists can interact with the data in novel ways not previously possible,such as visually exploring the gene expression patterns of an organ,and comparing genes based on their 3D expression profiles.Further,a biologist-driven use-case is presented,in which immersive environments facilitate biologists to explore and compare the heart expression profiles of different genes.展开更多
The space-air-ground integrated network(SAGIN) is regarded as the key approach to realize global coverage in future network and it reaches broad access for various services. Being the new paradigm of service, immersiv...The space-air-ground integrated network(SAGIN) is regarded as the key approach to realize global coverage in future network and it reaches broad access for various services. Being the new paradigm of service, immersive media(IM) has attracted users’ attention for its virtualization, but it poses challenges to network performance, e.g. bandwidth, rate, latency. However, the SAGIN has limitations in supporting IM services, such as 4 K/8 K video, virtual reality, and interactive games. In this paper, a novel service customized SAGIN architecture for IM applications(SAG-IM) is proposed, which achieves content interactive and real-time communication among terminal users. State-of-the-art research is investigated in detail to facilitate the combination of SAGIN and service customized technology, which provides endto-end differentiated services for users. Besides, the functional components of SAG-IM contain the infrastructure layer, perception layer, intelligence layer, and application layer, reaching the capabilities of intelligent management of the network. Moreover, to provide IM content with ultra-high-definition and high frame rate for the optimal user experience, the promising key technologies on intelligent routing and delivery are discussed. The performance evaluation shows the superiority of SAG-IM in supporting IM service.Finally, the prospects in practical application are high-lighted.展开更多
A 360°video stream provide users a choice of viewing one's own point of interest inside the immersive contents.Performing head or hand manipulations to view the interesting scene in a 360°video is very t...A 360°video stream provide users a choice of viewing one's own point of interest inside the immersive contents.Performing head or hand manipulations to view the interesting scene in a 360°video is very tedious and the user may view the interested frame during his head/hand movement or even lose it.While automatically extracting user's point of interest(UPI)in a 360°video is very challenging because of subjectivity and difference of comforts.To handle these challenges and provide user's the best and visually pleasant view,we propose an automatic approach by utilizing two CNN models:object detector and aesthetic score of the scene.The proposed framework is three folded:pre-processing,Deepdive architecture,and view selection pipeline.In first fold,an input 360°video-frame is divided into three sub frames,each one with 120°view.In second fold,each sub-frame is passed through CNN models to extract visual features in the sub-frames and calculate aesthetic score.Finally,decision pipeline selects the sub frame with salient object based on the detected object and calculated aesthetic score.As compared to other state-of-the-art techniques which are domain specific approaches i.e.,support sports 360°video,our syste m support most of the 360°videos genre.Performance evaluation of proposed framework on our own collected data from various websites indicate performance for different categories of 360°videos.展开更多
Immersive virtual product development is a new desi gn , developing and evaluation method of integrated product and processing tragedie s, which using VR, multi-discipline simulation and scientific visualization tec h...Immersive virtual product development is a new desi gn , developing and evaluation method of integrated product and processing tragedie s, which using VR, multi-discipline simulation and scientific visualization tec hnologies. Users may have the experiences of being part of a cyberspace environm ent with the ability to navigate and manipulate objects which have properties an d behaviors that correspond to those of the real world objects. We present a fra mework and prototype system of an immerse VPD (IVPD) which enables users to navi gate and interact with 3D peripherals with the display system. The framework of IVPD which we have defined can meet these requirements. In the immersive virtual environment, design will include four main parts: 3D CAD/modeler, multidiscipli ne simulations, CAM and discrete system simulation. 3D CAD/modeler can create 3D geometric objects and import models from other commercial softwares such as UG, CATIA etc. It can also store all kinds of models into databases with hierarchy which will provide geometric models with simulations and evaluations in later pr ocedures. Multidiscipline simulations can integrate many simulations such as FEA , CFD, Noisy and etc. Each kind of these simulation softwares will reflect a cer tain aspect of product or component’s performances. CAM, as a successor of prod uct development, mainly simulates the manufacturing procedures in the computer. Discrete system simulation will able to see the layout problems for a factory. I t is very useful for production management. Participants may actively view the v irtual world revolving around them while others control navigation and simul ations, and may interact with other members such as pass an object from one embo died manikin to another.展开更多
The new urbanization provides opportunities for the ecological protection of traditional regional culture. In the context of the integrated development of agriculture, tourism, and cultural industries, this paper inte...The new urbanization provides opportunities for the ecological protection of traditional regional culture. In the context of the integrated development of agriculture, tourism, and cultural industries, this paper integrates the thinking of "immersive theatre" and adopts the design method of multithread dramatic narrative mode to create a number of interactive flow lines in the architecture and focus on the sensory experiences of environment, enabling the traditional regional culture to really touch the audience.展开更多
Educational opportunities for students addressing issues in sustainable built environments are evolving with new learning approaches. Our study asked if technology mediated learning environments using AR （augmented r...Educational opportunities for students addressing issues in sustainable built environments are evolving with new learning approaches. Our study asked if technology mediated learning environments using AR （augmented reality） can enhance student learning in the architecture and engineering disciplines. There were multiple study sites, two of them University of Arkansas and Florida International University are discussed. At each site, three collaborative projects were assigned to student teams during fall 2016. Students analyzed an existing building and developed alternative solutions based on improving energy performance. Our paper presents： （1） the research challenge related to the integration of immersive head-mounted display technology providing visual simulations and interactive lessons for interdisciplinary collaboration; and （2） the progress of Phase 1 consisting of our control group results run without the use of AR technology.展开更多
The recent advancements in the field of Virtual Reality(VR)and Augmented Reality(AR)have a substantial impact on modern day technology by digitizing each and everything related to human life and open the doors to the ...The recent advancements in the field of Virtual Reality(VR)and Augmented Reality(AR)have a substantial impact on modern day technology by digitizing each and everything related to human life and open the doors to the next generation Software Technology(Soft Tech).VR and AR technology provide astonishing immersive contents with the help of high quality stitched panoramic contents and 360°imagery that widely used in the education,gaming,entertainment,and production sector.The immersive quality of VR and AR contents are greatly dependent on the perceptual quality of panoramic or 360°images,in fact a minor visual distortion can significantly degrade the overall quality.Thus,to ensure the quality of constructed panoramic contents for VR and AR applications,numerous Stitched Image Quality Assessment(SIQA)methods have been proposed to assess the quality of panoramic contents before using in VR and AR.In this survey,we provide a detailed overview of the SIQA literature and exclusively focus on objective SIQA methods presented till date.For better understanding,the objective SIQA methods are classified into two classes namely Full-Reference SIQA and No-Reference SIQA approaches.Each class is further categorized into traditional and deep learning-based methods and examined their performance for SIQA task.Further,we shortlist the publicly available benchmark SIQA datasets and evaluation metrices used for quality assessment of panoramic contents.In last,we highlight the current challenges in this area based on the existing SIQA methods and suggest future research directions that need to be target for further improvement in SIQA domain.展开更多
Intangible cultural heritage intervening in tourism can enrich tourism products and improve the attraction of scenic spots.Meantime,it also displays the rich cultural connotation of tourism products by virtue of the d...Intangible cultural heritage intervening in tourism can enrich tourism products and improve the attraction of scenic spots.Meantime,it also displays the rich cultural connotation of tourism products by virtue of the diversity of intangible cultural heritage,and well protects and inherits intangible cultural heritage,creating a new mode for scenic spot development with empowerment of culture and creation.From the perspective of immersive experience,this study discusses intangible cultural heritage entering scenic spots with Dawakun desert scenic spot in Yopurga County,Xinjiang as a case study.展开更多
Immersive theatre means put audience into the space where the story take place.Actors and actresses perform in the authentic environment and audience also in this environment,watching the peoceeding of the story close...Immersive theatre means put audience into the space where the story take place.Actors and actresses perform in the authentic environment and audience also in this environment,watching the peoceeding of the story closely.With the success of Sleep No More,more and more people pay attention to immersive theatre.Some Chinese theatre directors also launch out into doing similar things.It is no doubt that immersive theatre is popular now at home and abroad.However,as a new form of theatre,immersive theatre theoretical study is really inadequate.This text aims explain the connotation and concepts of immersive theatre or what is immersive theatre,the feature of immersive theatre in addition to its present situation in China,though Sleep No More,one of the most famous immersive theatres.I hope to offer reference for Chinese theatre people,make contributions for their study and creations,then again filling in gaps in immersive theatre theory.Only in this way,can immersive theatre develop healthily and can its ecology be constructed well.展开更多
In recent years,museums have shifted from“things as the core to people as the core”.The people-oriented navigation model has increasingly become the center of the museum’s youth education.However,the inherent short...In recent years,museums have shifted from“things as the core to people as the core”.The people-oriented navigation model has increasingly become the center of the museum’s youth education.However,the inherent shortcomings of traditional museum teaching no longer meet the needs of today’s society.Therefore,from the perspective of immersive teaching,the author innovates museum teaching.The design of a new museum teaching mode through the integration of the Dick&Carey model and the“learning”-based teaching model is important for the application of immersive teaching in museum education.展开更多
Technological innovation, driven towards the educational context, has favored the concept of interactive technological environments that may significantly contribute towards the teaching-learning processes. In that se...Technological innovation, driven towards the educational context, has favored the concept of interactive technological environments that may significantly contribute towards the teaching-learning processes. In that sense, mapping interactivity indicators that consider technical and operational aspects, supported by the available technical literature and based on the perspective of undergraduate engineers and teachers, becomes a fundamental activity in order to build interactive environments that may in fact adequately contribute for the professional education of our students, mainly the ones in engineering courses. Specifically, this paper shows preliminary studies within this perspective, showing how technological innovation may be understood and applied in the educational context. The study also shows the first interactivity indicator for a collaborative learning perspective, obtained from data collected through a qualitative content analysis methodology.展开更多
Environmental Acoustics is a professional course that educates students majoring in Acoustics.Affected by practical equipment and other factors,the teaching effect of knowledge points relevant to subjective auditory p...Environmental Acoustics is a professional course that educates students majoring in Acoustics.Affected by practical equipment and other factors,the teaching effect of knowledge points relevant to subjective auditory perception contained in the course is poor.Taking the course of Spatial Hearing and 3D Stereo as an example,this study develops a virtual simulation experiment system for the topic of subjective hearing perception in order to carry out the reform and practice of immersive teaching.Combined with the virtual simulation experiment project with high sense of presence,students are supported by the actual auditory perception effect in the whole learning process and have achieved good learning effect.展开更多
This paper provides an introduction and overview of the immersive teaching method,presents a simple teaching model used in the teaching of oral English in higher vocational college.The teaching design of presentation ...This paper provides an introduction and overview of the immersive teaching method,presents a simple teaching model used in the teaching of oral English in higher vocational college.The teaching design of presentation based on immersive teaching method can enhance students’subjective initiative in language learning in oral English classes in a better way,stimulate students’interests in learning the knowledge of language,and practice the use of language skills.展开更多
Objective:Research on methods of improving the affective experience of exercise remains limited,especially for low-active overweight adults.We investigated the effectiveness of a virtual-reality headset and headphones...Objective:Research on methods of improving the affective experience of exercise remains limited,especially for low-active overweight adults.We investigated the effectiveness of a virtual-reality headset and headphones in improving affective responses over conventionally delivered audiovisual stimulation.Methods:Low-active,overweight adults(16 women,5 men;age:34.67±9.62 years;body mass index:28.56±4.95 kg/m^2;peak oxygen uptake for men:29.14±6.56 mL/kg/min,for women:22.67±4.52 mL/kg/min,mean±SD)completed 15-min sessions of recumbent cycling at the ventilatory threshold:(a)high immersion(HI,virtual reality headset and headphones),(b)low immersion(LI,television screen and speakers),and(c)Control.During-exercise pleasure and post-exercise enj oyment were self-reported.Oxygenation of the right dorsolateral pre frontal cortex(dIPFC)was assessed with near infrared spectroscopy.Results:Higher pleasure was reported during HI than during LI and Control(Condition×Time interaction;p<0.001,ηp^2=0.43).Participants who reported a preference for low exercise intensity showed higher dIPFC oxygenation during Control,but this difference diminished during LI and HI(Condition×Time×Preference interaction;p=0.036,ηp^2=0.10).Conclusion:Compared with conventionally delivered audiovisual stimulation,using a virtual-reality headset strengthens the dissociative effect,further improving affective responses to exercise at the ventilatory threshold among overweight,low-active adults.Presumably by competing with interoceptive afferents at the level of sensory input,audiovisual stimulation may lessen reliance on cognitive efforts to attenuate declining affect,as indicated by lower right dIPFC activity,particularly among participants disinclined toward high exercise intensity.展开更多
文摘This paper describes how virtual classrooms and out-of-classroom instruction can be used to help students in ideological and political theory courses strengthen their identities and improve the efficiency of their assignments.By using immersive media technology,the course is turned into a form of entertainment,enriched with content,and combined with methods such as digital video editing and manipulation to meet the needs of students in university ideological and political theory courses.Virtual reality technology can create realistic virtual environments created by computers,enabling students to perceive and manipulate a variety of virtual objects,interact with them,and create a sense of immersion in the virtual environment.Research has shown the potential benefits of using immersive media technologies and augmented reality in education.The potential of virtual reality in education has been increasingly emphasized and has been widely researched and applied.
基金This research was funded by the Science and Technology Innovation Project for Laoshan Laboratory(No.LSKJ202204303)the National Natural Science Foundation of China(No.42030406)+1 种基金the Fundamental Research Funds for the Central Universities(No.202261006)the ESANRSCC Scientific Cooperation Project on Earth Observation Science and Applications:Dragon 5(No.58393).
文摘In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as the viewpoint of the panoramic sphere is inside the sphere.We compared three approaches to visualizing the earth for rendering the geographical information in a virtual reality environment.On the tasks of terrestrial and marine geographical information,we compare the visualization effects on a)a globe,b)a flat map and c)a panoramic sphere.Terrestrial geographical information tasks include the area comparison and direction determination.Marine geographical information tasks contain the visualization of sea surface temperature and sea surface currents.For terrestrial geographical information tasks,the experimental results show that the panoramic sphere outperforms the globe and the flat map,with a higher average accuracy and a shorter time.On marine geographical information task,the panoramic sphere visualization is also superior to the flat map and the globe in an immersive environment for the sea surface temperature data and the sea surface current fields.In all three visualization experiments,the panoramic sphere is most preferred by the participants,particularly for global,transcontinental and transoceanic needs.
文摘Immersive services are the typical emerging services in current IMT-2020 network.With the development of network evolution,real-time interactive applications emerge one after another.This article provides an overview on immersive services which focus on real-time interaction.The scenarios,framework,requirements,key technologies,and issues of interactive immersive service are presented.
文摘More diverse data on animal ecology are now available.This“data deluge”presents challenges for both biologists and computer scientists;however,it also creates opportunities to improve analysis and answer more holistic research questions.We aim to increase awareness of the current opportunity for interdisciplinary research between animal ecology researchers and computer scientists.Immersive analytics(IA)is an emerging research field in which investigations are performed into how immersive technologies,such as large display walls and virtual reality and augmented reality devices,can be used to improve data analysis,outcomes,and communication.These investigations have the potential to reduce the analysis effort and widen the range of questions that can be addressed.We propose that biologists and computer scientists combine their efforts to lay the foundation for IA in animal ecology research.We discuss the potential and the challenges and outline a path toward a structured approach.We imagine that a joint effort would combine the strengths and expertise of both communities,leading to a well-defined research agenda and design space,practical guidelines,robust and reusable software frameworks,reduced analysis effort,and better comparability of results.
文摘The developments in the area of brain research by analysing brain activity of individuals have given rise to many useful applications, such as diagnosing mental disorders more efficiently, treatment of cognitive disorders, and developing of brain-computer interfaces for treatment, communication and entertainment purposes. However, the development of such applications is hindered by a shortage of easy-to-use and comfortable sensors, as well as a lack of high-quality brain activity data. In the first part of this paper, a review of the status of BCI applications is presented followed by a proposal of a framework for developing an intelligent BCI headphone that takes leverages of the huge amount of data coming from playing video games to let the players experience a full immersive gaming experience.
文摘Virtual reality gaining popularity across various fields including culture,tourism,and sport Exploring an ancient building in an exhibition hall,enjoying a 360-degree video,skating in front of a big screen in the middle of summer...All of these are made possible by the advanced technology of virtual reality(VR),which constructs an artificial environment with scenes and objects that look like real,making people feel they are immersed in it.Using a VR headset,users can enjoy a variety of experiences in gaming,entertainment,socialising or other activities.
基金This project was partly funded by the Deutsche Forschungsgemeinschaft(DFG,German Research Foundation)-Project-ID 251654672-TRR 161by DFG Center of Excellence 2117“Centre for the Advanced Study of Collective Behaviour”(ID 422037984)M.R.was funded by an NH&MRC/Heart Foundation Career Development Fellowship and by an Australian Research Council Discovery Project DP190102771 Grant.
文摘Spatially resolved transcriptomics is an emerging class of high-throughput technologies that enable biologists to systematically investigate the expression of genes along with spatial information.Upon data acquisition,one major hurdle is the subsequent interpretation and visualization of the datasets acquired.To address this challenge,VR-Cardiomics is presented,which is a novel data visualization system with interactive functionalities designed to help biologists interpret spatially resolved transcriptomic datasets.By implementing the system in two separate immersive environments,fish tank virtual reality(FTVR)and head-mounted display virtual reality(HMD-VR),biologists can interact with the data in novel ways not previously possible,such as visually exploring the gene expression patterns of an organ,and comparing genes based on their 3D expression profiles.Further,a biologist-driven use-case is presented,in which immersive environments facilitate biologists to explore and compare the heart expression profiles of different genes.
基金supported by the National Key Research and Development Program of China (No.2019YFB1803103)in part by the BUPT Excellent Ph.D. Students Foundation (No.CX2021113)。
文摘The space-air-ground integrated network(SAGIN) is regarded as the key approach to realize global coverage in future network and it reaches broad access for various services. Being the new paradigm of service, immersive media(IM) has attracted users’ attention for its virtualization, but it poses challenges to network performance, e.g. bandwidth, rate, latency. However, the SAGIN has limitations in supporting IM services, such as 4 K/8 K video, virtual reality, and interactive games. In this paper, a novel service customized SAGIN architecture for IM applications(SAG-IM) is proposed, which achieves content interactive and real-time communication among terminal users. State-of-the-art research is investigated in detail to facilitate the combination of SAGIN and service customized technology, which provides endto-end differentiated services for users. Besides, the functional components of SAG-IM contain the infrastructure layer, perception layer, intelligence layer, and application layer, reaching the capabilities of intelligent management of the network. Moreover, to provide IM content with ultra-high-definition and high frame rate for the optimal user experience, the promising key technologies on intelligent routing and delivery are discussed. The performance evaluation shows the superiority of SAG-IM in supporting IM service.Finally, the prospects in practical application are high-lighted.
文摘A 360°video stream provide users a choice of viewing one's own point of interest inside the immersive contents.Performing head or hand manipulations to view the interesting scene in a 360°video is very tedious and the user may view the interested frame during his head/hand movement or even lose it.While automatically extracting user's point of interest(UPI)in a 360°video is very challenging because of subjectivity and difference of comforts.To handle these challenges and provide user's the best and visually pleasant view,we propose an automatic approach by utilizing two CNN models:object detector and aesthetic score of the scene.The proposed framework is three folded:pre-processing,Deepdive architecture,and view selection pipeline.In first fold,an input 360°video-frame is divided into three sub frames,each one with 120°view.In second fold,each sub-frame is passed through CNN models to extract visual features in the sub-frames and calculate aesthetic score.Finally,decision pipeline selects the sub frame with salient object based on the detected object and calculated aesthetic score.As compared to other state-of-the-art techniques which are domain specific approaches i.e.,support sports 360°video,our syste m support most of the 360°videos genre.Performance evaluation of proposed framework on our own collected data from various websites indicate performance for different categories of 360°videos.
文摘Immersive virtual product development is a new desi gn , developing and evaluation method of integrated product and processing tragedie s, which using VR, multi-discipline simulation and scientific visualization tec hnologies. Users may have the experiences of being part of a cyberspace environm ent with the ability to navigate and manipulate objects which have properties an d behaviors that correspond to those of the real world objects. We present a fra mework and prototype system of an immerse VPD (IVPD) which enables users to navi gate and interact with 3D peripherals with the display system. The framework of IVPD which we have defined can meet these requirements. In the immersive virtual environment, design will include four main parts: 3D CAD/modeler, multidiscipli ne simulations, CAM and discrete system simulation. 3D CAD/modeler can create 3D geometric objects and import models from other commercial softwares such as UG, CATIA etc. It can also store all kinds of models into databases with hierarchy which will provide geometric models with simulations and evaluations in later pr ocedures. Multidiscipline simulations can integrate many simulations such as FEA , CFD, Noisy and etc. Each kind of these simulation softwares will reflect a cer tain aspect of product or component’s performances. CAM, as a successor of prod uct development, mainly simulates the manufacturing procedures in the computer. Discrete system simulation will able to see the layout problems for a factory. I t is very useful for production management. Participants may actively view the v irtual world revolving around them while others control navigation and simul ations, and may interact with other members such as pass an object from one embo died manikin to another.
基金Sponsored by Science and Technology Program of the Ministry of Housing and Urban-Rural Development(2016-K1-035)Science and Technology Program of Jiangsu Provincial Department of Housing and Urban-Rural Development(2016ZD43,2016ZD55)Innovative Training Program for Jiangsu Provincial College Students(ycgy2017006)
文摘The new urbanization provides opportunities for the ecological protection of traditional regional culture. In the context of the integrated development of agriculture, tourism, and cultural industries, this paper integrates the thinking of "immersive theatre" and adopts the design method of multithread dramatic narrative mode to create a number of interactive flow lines in the architecture and focus on the sensory experiences of environment, enabling the traditional regional culture to really touch the audience.
基金Acknowledgments The work described in this paper was partially supported by the National Science Foundation under award No. 1504898. The Holoens-AR development work is underway at the Tesseract Center at the University of Arkansas under the direction of Dr. David Fredrick with Keenan Cole, Chloe Costello and undergraduate Corey Booth. Documentation of the Vol Walker construction was done by the Center for Advanced Spatial Technologies （CAST） at the University of Arkansas.
文摘Educational opportunities for students addressing issues in sustainable built environments are evolving with new learning approaches. Our study asked if technology mediated learning environments using AR （augmented reality） can enhance student learning in the architecture and engineering disciplines. There were multiple study sites, two of them University of Arkansas and Florida International University are discussed. At each site, three collaborative projects were assigned to student teams during fall 2016. Students analyzed an existing building and developed alternative solutions based on improving energy performance. Our paper presents： （1） the research challenge related to the integration of immersive head-mounted display technology providing visual simulations and interactive lessons for interdisciplinary collaboration; and （2） the progress of Phase 1 consisting of our control group results run without the use of AR technology.
文摘The recent advancements in the field of Virtual Reality(VR)and Augmented Reality(AR)have a substantial impact on modern day technology by digitizing each and everything related to human life and open the doors to the next generation Software Technology(Soft Tech).VR and AR technology provide astonishing immersive contents with the help of high quality stitched panoramic contents and 360°imagery that widely used in the education,gaming,entertainment,and production sector.The immersive quality of VR and AR contents are greatly dependent on the perceptual quality of panoramic or 360°images,in fact a minor visual distortion can significantly degrade the overall quality.Thus,to ensure the quality of constructed panoramic contents for VR and AR applications,numerous Stitched Image Quality Assessment(SIQA)methods have been proposed to assess the quality of panoramic contents before using in VR and AR.In this survey,we provide a detailed overview of the SIQA literature and exclusively focus on objective SIQA methods presented till date.For better understanding,the objective SIQA methods are classified into two classes namely Full-Reference SIQA and No-Reference SIQA approaches.Each class is further categorized into traditional and deep learning-based methods and examined their performance for SIQA task.Further,we shortlist the publicly available benchmark SIQA datasets and evaluation metrices used for quality assessment of panoramic contents.In last,we highlight the current challenges in this area based on the existing SIQA methods and suggest future research directions that need to be target for further improvement in SIQA domain.
基金Sponsored by Shandong Provincial Soft Science Research Program(2020RKB01081)Shandong Social Science Planning and Research Project(19CXWJ10)。
文摘Intangible cultural heritage intervening in tourism can enrich tourism products and improve the attraction of scenic spots.Meantime,it also displays the rich cultural connotation of tourism products by virtue of the diversity of intangible cultural heritage,and well protects and inherits intangible cultural heritage,creating a new mode for scenic spot development with empowerment of culture and creation.From the perspective of immersive experience,this study discusses intangible cultural heritage entering scenic spots with Dawakun desert scenic spot in Yopurga County,Xinjiang as a case study.
文摘Immersive theatre means put audience into the space where the story take place.Actors and actresses perform in the authentic environment and audience also in this environment,watching the peoceeding of the story closely.With the success of Sleep No More,more and more people pay attention to immersive theatre.Some Chinese theatre directors also launch out into doing similar things.It is no doubt that immersive theatre is popular now at home and abroad.However,as a new form of theatre,immersive theatre theoretical study is really inadequate.This text aims explain the connotation and concepts of immersive theatre or what is immersive theatre,the feature of immersive theatre in addition to its present situation in China,though Sleep No More,one of the most famous immersive theatres.I hope to offer reference for Chinese theatre people,make contributions for their study and creations,then again filling in gaps in immersive theatre theory.Only in this way,can immersive theatre develop healthily and can its ecology be constructed well.
文摘In recent years,museums have shifted from“things as the core to people as the core”.The people-oriented navigation model has increasingly become the center of the museum’s youth education.However,the inherent shortcomings of traditional museum teaching no longer meet the needs of today’s society.Therefore,from the perspective of immersive teaching,the author innovates museum teaching.The design of a new museum teaching mode through the integration of the Dick&Carey model and the“learning”-based teaching model is important for the application of immersive teaching in museum education.
文摘Technological innovation, driven towards the educational context, has favored the concept of interactive technological environments that may significantly contribute towards the teaching-learning processes. In that sense, mapping interactivity indicators that consider technical and operational aspects, supported by the available technical literature and based on the perspective of undergraduate engineers and teachers, becomes a fundamental activity in order to build interactive environments that may in fact adequately contribute for the professional education of our students, mainly the ones in engineering courses. Specifically, this paper shows preliminary studies within this perspective, showing how technological innovation may be understood and applied in the educational context. The study also shows the first interactivity indicator for a collaborative learning perspective, obtained from data collected through a qualitative content analysis methodology.
基金This research was supported by the Key Teaching Reform Project of Northwestern Polytechnical University-Practical Teaching Reform of Environmental Acoustics Course Group Supported by Virtual Auditory Perception Experiment Project(Project Number:2021JGZ04).
文摘Environmental Acoustics is a professional course that educates students majoring in Acoustics.Affected by practical equipment and other factors,the teaching effect of knowledge points relevant to subjective auditory perception contained in the course is poor.Taking the course of Spatial Hearing and 3D Stereo as an example,this study develops a virtual simulation experiment system for the topic of subjective hearing perception in order to carry out the reform and practice of immersive teaching.Combined with the virtual simulation experiment project with high sense of presence,students are supported by the actual auditory perception effect in the whole learning process and have achieved good learning effect.
文摘This paper provides an introduction and overview of the immersive teaching method,presents a simple teaching model used in the teaching of oral English in higher vocational college.The teaching design of presentation based on immersive teaching method can enhance students’subjective initiative in language learning in oral English classes in a better way,stimulate students’interests in learning the knowledge of language,and practice the use of language skills.
基金Sheffield Hallam University for financial support that allowed for the purchase of equipment used in this study (NIRS, virtualreality headset)
文摘Objective:Research on methods of improving the affective experience of exercise remains limited,especially for low-active overweight adults.We investigated the effectiveness of a virtual-reality headset and headphones in improving affective responses over conventionally delivered audiovisual stimulation.Methods:Low-active,overweight adults(16 women,5 men;age:34.67±9.62 years;body mass index:28.56±4.95 kg/m^2;peak oxygen uptake for men:29.14±6.56 mL/kg/min,for women:22.67±4.52 mL/kg/min,mean±SD)completed 15-min sessions of recumbent cycling at the ventilatory threshold:(a)high immersion(HI,virtual reality headset and headphones),(b)low immersion(LI,television screen and speakers),and(c)Control.During-exercise pleasure and post-exercise enj oyment were self-reported.Oxygenation of the right dorsolateral pre frontal cortex(dIPFC)was assessed with near infrared spectroscopy.Results:Higher pleasure was reported during HI than during LI and Control(Condition×Time interaction;p<0.001,ηp^2=0.43).Participants who reported a preference for low exercise intensity showed higher dIPFC oxygenation during Control,but this difference diminished during LI and HI(Condition×Time×Preference interaction;p=0.036,ηp^2=0.10).Conclusion:Compared with conventionally delivered audiovisual stimulation,using a virtual-reality headset strengthens the dissociative effect,further improving affective responses to exercise at the ventilatory threshold among overweight,low-active adults.Presumably by competing with interoceptive afferents at the level of sensory input,audiovisual stimulation may lessen reliance on cognitive efforts to attenuate declining affect,as indicated by lower right dIPFC activity,particularly among participants disinclined toward high exercise intensity.
