摘要
With the rise of the concept of the metaverse,mixed reality continues to receive keen attention from all over the world.Academia and industry worldwide are constantly innovating the key technologies of mixed reality software and hardware.For a long time,the field of mixed reality mainly focused on display technology,but with the increase of mixed reality applications,people gradually found that the lack of interactive technology and solutions has become a bottleneck restricting the development of mixed reality technology.On the mixed reality platform represented by AR/VR helmets,people cannot completely get rid of the remote control to complete human-computer interaction,which greatly limits the development of applications on it.How to enable users to exchange information with computers based on the natural interaction modality has become an urgent problem to be solved.